Nov 28 13:50:57 user nova-compute[75453]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75453) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75453) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75453) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 13:50:57 user nova-compute[75453]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:50:57 user nova-compute[75453]: INFO nova.virt.driver [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 28 13:50:57 user nova-compute[75453]: INFO nova.compute.provider_config [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] Acquiring lock "singleton_lock" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] Acquired lock "singleton_lock" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] Releasing lock "singleton_lock" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] Full set of CONF: {{(pid=75453) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ******************************************************************************** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] Configuration options gathered from: {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ================================================================================ {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] allow_resize_to_same_host      = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] arq_binding_timeout            = 300 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] backdoor_port                  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] backdoor_socket                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] block_device_allocate_retries  = 300 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] block_device_allocate_retries_interval = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cert                           = self.pem {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute_monitors               = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] config_dir                     = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] config_drive_format            = iso9660 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] config_source                  = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] console_host                   = user {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] control_exchange               = nova {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cpu_allocation_ratio           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] daemon                         = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] debug                          = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] default_access_ip_network_name = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] default_availability_zone      = nova {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] default_ephemeral_format       = ext4 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] default_green_pool_size        = 1000 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] default_schedule_zone          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] disk_allocation_ratio          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] enable_new_services            = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] enabled_ssl_apis               = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] flat_injected                  = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] force_config_drive             = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] force_raw_images               = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] graceful_shutdown_timeout      = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] heal_instance_info_cache_interval = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] host                           = user {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] instance_build_timeout         = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] instance_delete_interval       = 300 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] instance_name_template         = instance-%08x {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] instance_usage_audit           = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] instance_usage_audit_period    = month {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] internal_service_availability_zone = internal {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] key                            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] live_migration_retry_count     = 30 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] log_config_append              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] log_dir                        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] log_file                       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] log_options                    = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] log_rotate_interval            = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] log_rotate_interval_type       = days {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] log_rotation_type              = none {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] long_rpc_timeout               = 1800 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] max_concurrent_builds          = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] max_concurrent_live_migrations = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] max_concurrent_snapshots       = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] max_local_block_devices        = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] max_logfile_count              = 30 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] max_logfile_size_mb            = 200 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] maximum_instance_delete_attempts = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] metadata_listen                = 0.0.0.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] metadata_listen_port           = 8775 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] metadata_workers               = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] migrate_max_retries            = -1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] mkisofs_cmd                    = genisoimage {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] my_ip                          = 10.0.0.210 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] network_allocate_retries       = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] osapi_compute_listen_port      = 8774 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] osapi_compute_unique_server_name_scope =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] osapi_compute_workers          = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] password_length                = 12 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] periodic_enable                = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] periodic_fuzzy_delay           = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] pointer_model                  = ps2mouse {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] preallocate_images             = none {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] publish_errors                 = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] pybasedir                      = /opt/stack/nova {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ram_allocation_ratio           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] rate_limit_burst               = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] rate_limit_except_level        = CRITICAL {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] rate_limit_interval            = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] reboot_timeout                 = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] reclaim_instance_interval      = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] record                         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] reimage_timeout_per_gb         = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] report_interval                = 120 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] rescue_timeout                 = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] reserved_host_cpus             = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] reserved_host_disk_mb          = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] reserved_host_memory_mb        = 512 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] reserved_huge_pages            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] resize_confirm_window          = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] resize_fs_using_block_device   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] resume_guests_state_on_host_boot = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] rpc_response_timeout           = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] run_external_periodic_tasks    = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] running_deleted_instance_action = reap {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] running_deleted_instance_timeout = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler_instance_sync_interval = 120 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_down_time              = 720 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] servicegroup_driver            = db {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] shelved_offload_time           = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] shelved_poll_interval          = 3600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] shutdown_timeout               = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] source_is_ipv6                 = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ssl_only                       = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] state_path                     = /opt/stack/data/nova {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] sync_power_state_interval      = 600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] sync_power_state_pool_size     = 1000 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] syslog_log_facility            = LOG_USER {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] tempdir                        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] timeout_nbd                    = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] transport_url                  = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] update_resources_interval      = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] use_cow_images                 = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] use_eventlog                   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] use_journal                    = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] use_json                       = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] use_rootwrap_daemon            = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] use_stderr                     = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] use_syslog                     = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vcpu_pin_set                   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plugging_is_fatal          = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plugging_timeout           = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] virt_mkfs                      = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] volume_usage_poll_interval     = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] watch_log_file                 = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] web                            = /usr/share/spice-html5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_concurrency.disable_process_locking = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.auth_strategy              = keystone {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.compute_link_prefix        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.dhcp_domain                = novalocal {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.enable_instance_password   = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.glance_link_prefix         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.instance_list_per_project_cells = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.list_records_by_skipping_down_cells = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.local_metadata_per_cell    = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.max_limit                  = 1000 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.metadata_cache_expiration  = 15 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.neutron_default_tenant_id  = default {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.use_forwarded_for          = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.use_neutron_default_nets   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.vendordata_dynamic_targets = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.vendordata_jsonfile_path   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.backend_argument         = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.config_prefix            = cache.oslo {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.dead_timeout             = 60.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.debug_cache_backend      = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.enable_retry_client      = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.enable_socket_keepalive  = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.enabled                  = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.expiration_time          = 600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.hashclient_retry_attempts = 2 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_dead_retry      = 300 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_password        =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_sasl_enabled    = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.memcache_username        =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.proxies                  = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.retry_attempts           = 2 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.retry_delay              = 0.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.socket_keepalive_count   = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.socket_keepalive_idle    = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.socket_keepalive_interval = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.tls_allowed_ciphers      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.tls_cafile               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.tls_certfile             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.tls_enabled              = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cache.tls_keyfile              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.auth_section            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.auth_type               = password {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.cafile                  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.certfile                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.collect_timing          = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.cross_az_attach         = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.debug                   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.endpoint_template       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.http_retries            = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.insecure                = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.keyfile                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.os_region_name          = RegionOne {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.split_loggers           = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cinder.timeout                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.cpu_dedicated_set      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.cpu_shared_set         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.image_type_exclude_list = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.resource_provider_association_refresh = 300 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.shutdown_retry_interval = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] conductor.workers              = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] console.allowed_origins        = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] console.ssl_ciphers            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] console.ssl_minimum_version    = default {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] consoleauth.token_ttl          = 600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.cafile                  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.certfile                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.collect_timing          = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.connect_retries         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.connect_retry_delay     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.endpoint_override       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.insecure                = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.keyfile                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.max_version             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.min_version             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.region_name             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.service_name            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.service_type            = accelerator {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.split_loggers           = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.status_code_retries     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.status_code_retry_delay = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.timeout                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] cyborg.version                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.backend               = sqlalchemy {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.connection            = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.connection_debug      = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.connection_parameters =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.connection_recycle_time = 3600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.connection_trace      = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.db_inc_retry_interval = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.db_max_retries        = 20 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.db_max_retry_interval = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.db_retry_interval     = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.max_overflow          = 50 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.max_pool_size         = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.max_retries           = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.mysql_wsrep_sync_wait = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.pool_timeout          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.retry_interval        = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.slave_connection      = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] database.sqlite_synchronous    = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.backend           = sqlalchemy {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.connection        = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.connection_debug  = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.connection_parameters =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.connection_recycle_time = 3600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.connection_trace  = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.db_inc_retry_interval = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.db_max_retries    = 20 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.db_max_retry_interval = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.db_retry_interval = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.max_overflow      = 50 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.max_pool_size     = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.max_retries       = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.pool_timeout      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.retry_interval    = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.slave_connection  = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] api_database.sqlite_synchronous = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] devices.enabled_mdev_types     = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ephemeral_storage_encryption.enabled = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.api_servers             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.cafile                  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.certfile                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.collect_timing          = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.connect_retries         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.connect_retry_delay     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.debug                   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.default_trusted_certificate_ids = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.enable_certificate_validation = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.enable_rbd_download     = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.endpoint_override       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.insecure                = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.keyfile                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.max_version             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.min_version             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.num_retries             = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.rbd_ceph_conf           =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.rbd_connect_timeout     = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.rbd_pool                =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.rbd_user                =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.region_name             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.service_name            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.service_type            = image {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.split_loggers           = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.status_code_retries     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.status_code_retry_delay = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.timeout                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.verify_glance_signatures = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] glance.version                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] guestfs.debug                  = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.config_drive_cdrom      = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.config_drive_inject_password = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.enable_remotefx         = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.instances_path_share    =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.limit_cpu_features      = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.use_multipath_io        = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.vswitch_name            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] mks.enabled                    = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] image_cache.manager_interval   = 2400 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] image_cache.precache_concurrency = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] image_cache.remove_unused_base_images = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] image_cache.subdirectory_name  = _base {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.api_max_retries         = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.api_retry_interval      = 2 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.auth_section            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.auth_type               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.cafile                  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.certfile                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.collect_timing          = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.conductor_group         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.connect_retries         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.connect_retry_delay     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.endpoint_override       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.insecure                = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.keyfile                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.max_version             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.min_version             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.peer_list               = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.region_name             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.serial_console_state_timeout = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.service_name            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.service_type            = baremetal {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.split_loggers           = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.status_code_retries     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.status_code_retry_delay = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.timeout                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ironic.version                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] key_manager.fixed_key          = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.barbican_api_version  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.barbican_endpoint     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.barbican_endpoint_type = public {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.barbican_region_name  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.cafile                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.certfile              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.collect_timing        = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.insecure              = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.keyfile               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.number_of_retries     = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.retry_delay           = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.send_service_user_token = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.split_loggers         = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.timeout               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.verify_ssl            = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican.verify_ssl_path       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican_service_user.auth_section = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican_service_user.auth_type = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican_service_user.cafile   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican_service_user.certfile = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican_service_user.collect_timing = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican_service_user.insecure = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican_service_user.keyfile  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican_service_user.split_loggers = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] barbican_service_user.timeout  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.approle_role_id          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.approle_secret_id        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.cafile                   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.certfile                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.collect_timing           = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.insecure                 = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.keyfile                  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.kv_mountpoint            = secret {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.kv_path                  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.kv_version               = 2 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.namespace                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.root_token_id            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.split_loggers            = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.ssl_ca_crt_file          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.timeout                  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.use_ssl                  = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.auth_section          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.auth_type             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.cafile                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.certfile              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.collect_timing        = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.connect_retries       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.connect_retry_delay   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.endpoint_override     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.insecure              = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.keyfile               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.max_version           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.min_version           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.region_name           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.service_name          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.service_type          = identity {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.split_loggers         = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.status_code_retries   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.status_code_retry_delay = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.timeout               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] keystone.version               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.connection_uri         =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.cpu_mode               = custom {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: WARNING oslo_config.cfg [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.cpu_power_governor_high = performance {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.cpu_power_management   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.device_detach_attempts = 8 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.device_detach_timeout  = 20 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.disk_cachemodes        = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.disk_prefix            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.enabled_perf_events    = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.file_backed_memory     = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.gid_maps               = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.hw_disk_discard        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.hw_machine_type        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.images_rbd_pool        = rbd {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.images_type            = default {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.images_volume_group    = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.inject_key             = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.inject_partition       = -2 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.inject_password        = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.iscsi_iface            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.iser_use_multipath     = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_downtime = 500 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_inbound_addr = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_scheme  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_timeout_action = abort {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_tunnelled = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: WARNING oslo_config.cfg [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 28 13:50:57 user nova-compute[75453]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 28 13:50:57 user nova-compute[75453]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 28 13:50:57 user nova-compute[75453]: and ``live_migration_inbound_addr`` respectively.
Nov 28 13:50:57 user nova-compute[75453]: ).  Its value may be silently ignored in the future.
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.live_migration_with_native_tls = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.max_queues             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.nfs_mount_options      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.num_pcie_ports         = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.pmem_namespaces        = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.quobyte_client_cfg     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rbd_secret_uuid        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rbd_user               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rescue_image_id        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rescue_kernel_id       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.rx_queue_size          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.smbfs_mount_options    =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.snapshot_compression   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.snapshot_image_format  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.sparse_logical_volumes = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.swtpm_enabled          = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.swtpm_group            = tss {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.swtpm_user             = tss {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.sysinfo_serial         = unique {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.tb_cache_size          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.tx_queue_size          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.uid_maps               = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.use_virtio_for_bridges = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.virt_type              = kvm {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.volume_clear           = zero {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.volume_clear_size      = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.volume_use_multipath   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.vzstorage_cache_path   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.auth_section           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.auth_type              = password {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.cafile                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.certfile               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.collect_timing         = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.connect_retries        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.connect_retry_delay    = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.default_floating_pool  = public {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.endpoint_override      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.extension_sync_interval = 600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.http_retries           = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.insecure               = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.keyfile                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.max_version            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.min_version            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.ovs_bridge             = br-int {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.physnets               = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.region_name            = RegionOne {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.service_metadata_proxy = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.service_name           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.service_type           = network {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.split_loggers          = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.status_code_retries    = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.status_code_retry_delay = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.timeout                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] neutron.version                = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] notifications.bdms_in_notifications = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] notifications.default_level    = INFO {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] notifications.notification_format = unversioned {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] notifications.notify_on_state_change = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] pci.alias                      = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] pci.device_spec                = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] pci.report_in_placement        = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.auth_section         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.auth_type            = password {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.cafile               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.certfile             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.collect_timing       = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.connect_retries      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.connect_retry_delay  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.default_domain_id    = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.default_domain_name  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.domain_id            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.domain_name          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.endpoint_override    = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.insecure             = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.keyfile              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.max_version          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.min_version          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.password             = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.project_domain_id    = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.project_domain_name  = Default {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.project_id           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.project_name         = service {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.region_name          = RegionOne {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.service_name         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.service_type         = placement {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.split_loggers        = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.status_code_retries  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.status_code_retry_delay = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.system_scope         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.timeout              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.trust_id             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.user_domain_id       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.user_domain_name     = Default {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.user_id              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.username             = placement {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] placement.version              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.cores                    = 20 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.count_usage_from_placement = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.injected_file_content_bytes = 10240 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.injected_file_path_length = 255 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.injected_files           = 5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.instances                = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.key_pairs                = 100 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.metadata_items           = 128 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.ram                      = 51200 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:57 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.recheck_quota            = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.server_group_members     = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] quota.server_groups            = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] rdp.enabled                    = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.image_metadata_prefilter = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.max_attempts         = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.max_placement_results = 1000 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] scheduler.workers              = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.host_subset_size = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.isolated_hosts = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.isolated_images = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.pci_in_placement = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.track_instance_changes = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] metrics.required               = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] metrics.weight_multiplier      = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] metrics.weight_setting         = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] serial_console.enabled         = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] serial_console.port_range      = 10000:20000 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] serial_console.serialproxy_port = 6083 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.auth_section      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.auth_type         = password {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.cafile            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.certfile          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.collect_timing    = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.insecure          = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.keyfile           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.send_service_user_token = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.split_loggers     = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] service_user.timeout           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.agent_enabled            = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.enabled                  = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.html5proxy_port          = 6082 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.image_compression        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.jpeg_compression         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.playback_compression     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.server_listen            = 127.0.0.1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.streaming_mode           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] spice.zlib_compression         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] upgrade_levels.baseapi         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] upgrade_levels.compute         = auto {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] upgrade_levels.conductor       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] upgrade_levels.scheduler       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vendordata_dynamic_auth.cafile = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vendordata_dynamic_auth.certfile = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vendordata_dynamic_auth.insecure = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vendordata_dynamic_auth.timeout = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.api_retry_count         = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.ca_file                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.cache_prefix            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.cluster_name            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.connection_pool_size    = 10 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.console_delay_seconds   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.datastore_regex         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.host_ip                 = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.host_password           = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.host_port               = 443 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.host_username           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.insecure                = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.integration_bridge      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.maximum_objects         = 100 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.pbm_default_policy      = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.pbm_enabled             = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.pbm_wsdl_location       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.serial_port_proxy_uri   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.serial_port_service_uri = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.task_poll_interval      = 0.5 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.use_linked_clone        = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.vnc_keymap              = en-us {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.vnc_port                = 5900 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vmware.vnc_port_total          = 10000 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.auth_schemes               = ['none'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.enabled                    = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.novncproxy_port            = 6080 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.vencrypt_ca_certs          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.vencrypt_client_cert       = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vnc.vencrypt_client_key        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.disable_rootwrap   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.enable_numa_live_migration = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.libvirt_disable_apic = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.client_socket_timeout     = 900 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.default_pool_size         = 1000 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.keep_alive                = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.max_header_line           = 16384 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.ssl_ca_file               = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.ssl_cert_file             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.ssl_key_file              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.tcp_keepidle              = 600 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] zvm.ca_file                    = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] zvm.cloud_connector_url        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] zvm.reachable_timeout          = 300 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.enforce_new_defaults = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.enforce_scope      = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.policy_default_rule = default {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.connection_string     = messaging:// {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.enabled               = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.es_doc_type           = notification {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.es_scroll_size        = 10000 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.es_scroll_time        = 2m {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.filter_error_trace    = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.hmac_keys             = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.sentinel_service_name = mymaster {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.socket_timeout        = 0.1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.trace_requests        = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler.trace_sqlalchemy      = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler_jaeger.process_tags   = {} {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler_jaeger.service_name_prefix = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] profiler_otlp.service_name_prefix = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] remote_debug.host              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] remote_debug.port              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_notifications.retry = -1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.auth_section        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.auth_type           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.cafile              = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.certfile            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.collect_timing      = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.connect_retries     = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.connect_retry_delay = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.endpoint_id         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.endpoint_override   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.insecure            = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.keyfile             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.max_version         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.min_version         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.region_name         = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.service_name        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.service_type        = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.split_loggers       = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.status_code_retries = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.status_code_retry_delay = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.timeout             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.valid_interfaces    = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_limit.version             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_reports.file_event_handler = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] oslo_reports.log_dir           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_ovs_privileged.group  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] vif_plug_ovs_privileged.user   = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_ovs.isolate_vif         = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] os_brick.lock_path             = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] privsep_osbrick.capabilities   = [21] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] privsep_osbrick.group          = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] privsep_osbrick.helper_command = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] privsep_osbrick.user           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] nova_sys_admin.group           = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] nova_sys_admin.helper_command  = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] nova_sys_admin.user            = None {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG oslo_service.service [None req-b22bbec1-b4ab-4f6d-a08a-9eb78dba74d5 None None] ******************************************************************************** {{(pid=75453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 28 13:50:58 user nova-compute[75453]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 28 13:50:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Connecting to libvirt: qemu:///system {{(pid=75453) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f02542d63e0> {{(pid=75453) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 28 13:50:58 user nova-compute[75453]: libvirt:  error : internal error: could not initialize domain event timer
Nov 28 13:50:58 user nova-compute[75453]: WARNING nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 28 13:50:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f02542d63e0> {{(pid=75453) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Starting native event thread {{(pid=75453) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Starting green dispatch thread {{(pid=75453) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 28 13:50:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Starting connection event dispatch thread {{(pid=75453) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 28 13:50:58 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Connection event '1' reason 'None'
Nov 28 13:50:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 13:50:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.mount [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Initialising _HostMountState generation 0 {{(pid=75453) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 28 13:51:05 user nova-compute[75453]: INFO nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt host capabilities <capabilities>
Nov 28 13:51:05 user nova-compute[75453]:   <host>
Nov 28 13:51:05 user nova-compute[75453]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 28 13:51:05 user nova-compute[75453]:     <cpu>
Nov 28 13:51:05 user nova-compute[75453]:       <arch>x86_64</arch>
Nov 28 13:51:05 user nova-compute[75453]:       <model>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <vendor>Intel</vendor>
Nov 28 13:51:05 user nova-compute[75453]:       <microcode version='1070'/>
Nov 28 13:51:05 user nova-compute[75453]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 28 13:51:05 user nova-compute[75453]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='ss'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='vmx'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='pcid'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='osxsave'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='hypervisor'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='arat'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='tsc_adjust'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='md-clear'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='arch-capabilities'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='invtsc'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='rsba'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature name='skip-l1dfl-vmentry'/>
Nov 28 13:51:05 user nova-compute[75453]:       <pages unit='KiB' size='4'/>
Nov 28 13:51:05 user nova-compute[75453]:       <pages unit='KiB' size='2048'/>
Nov 28 13:51:05 user nova-compute[75453]:     </cpu>
Nov 28 13:51:05 user nova-compute[75453]:     <power_management>
Nov 28 13:51:05 user nova-compute[75453]:       <suspend_mem/>
Nov 28 13:51:05 user nova-compute[75453]:       <suspend_disk/>
Nov 28 13:51:05 user nova-compute[75453]:       <suspend_hybrid/>
Nov 28 13:51:05 user nova-compute[75453]:     </power_management>
Nov 28 13:51:05 user nova-compute[75453]:     <iommu support='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     <migration_features>
Nov 28 13:51:05 user nova-compute[75453]:       <live/>
Nov 28 13:51:05 user nova-compute[75453]:       <uri_transports>
Nov 28 13:51:05 user nova-compute[75453]:         <uri_transport>tcp</uri_transport>
Nov 28 13:51:05 user nova-compute[75453]:         <uri_transport>rdma</uri_transport>
Nov 28 13:51:05 user nova-compute[75453]:       </uri_transports>
Nov 28 13:51:05 user nova-compute[75453]:     </migration_features>
Nov 28 13:51:05 user nova-compute[75453]:     <topology>
Nov 28 13:51:05 user nova-compute[75453]:       <cells num='2'>
Nov 28 13:51:05 user nova-compute[75453]:         <cell id='0'>
Nov 28 13:51:05 user nova-compute[75453]:           <memory unit='KiB'>8140616</memory>
Nov 28 13:51:05 user nova-compute[75453]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 28 13:51:05 user nova-compute[75453]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 13:51:05 user nova-compute[75453]:           <distances>
Nov 28 13:51:05 user nova-compute[75453]:             <sibling id='0' value='10'/>
Nov 28 13:51:05 user nova-compute[75453]:             <sibling id='1' value='20'/>
Nov 28 13:51:05 user nova-compute[75453]:           </distances>
Nov 28 13:51:05 user nova-compute[75453]:           <cpus num='6'>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 28 13:51:05 user nova-compute[75453]:           </cpus>
Nov 28 13:51:05 user nova-compute[75453]:         </cell>
Nov 28 13:51:05 user nova-compute[75453]:         <cell id='1'>
Nov 28 13:51:05 user nova-compute[75453]:           <memory unit='KiB'>8255100</memory>
Nov 28 13:51:05 user nova-compute[75453]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 28 13:51:05 user nova-compute[75453]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 13:51:05 user nova-compute[75453]:           <distances>
Nov 28 13:51:05 user nova-compute[75453]:             <sibling id='0' value='20'/>
Nov 28 13:51:05 user nova-compute[75453]:             <sibling id='1' value='10'/>
Nov 28 13:51:05 user nova-compute[75453]:           </distances>
Nov 28 13:51:05 user nova-compute[75453]:           <cpus num='6'>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 28 13:51:05 user nova-compute[75453]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 28 13:51:05 user nova-compute[75453]:           </cpus>
Nov 28 13:51:05 user nova-compute[75453]:         </cell>
Nov 28 13:51:05 user nova-compute[75453]:       </cells>
Nov 28 13:51:05 user nova-compute[75453]:     </topology>
Nov 28 13:51:05 user nova-compute[75453]:     <cache>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 28 13:51:05 user nova-compute[75453]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 28 13:51:05 user nova-compute[75453]:     </cache>
Nov 28 13:51:05 user nova-compute[75453]:     <secmodel>
Nov 28 13:51:05 user nova-compute[75453]:       <model>apparmor</model>
Nov 28 13:51:05 user nova-compute[75453]:       <doi>0</doi>
Nov 28 13:51:05 user nova-compute[75453]:     </secmodel>
Nov 28 13:51:05 user nova-compute[75453]:     <secmodel>
Nov 28 13:51:05 user nova-compute[75453]:       <model>dac</model>
Nov 28 13:51:05 user nova-compute[75453]:       <doi>0</doi>
Nov 28 13:51:05 user nova-compute[75453]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 28 13:51:05 user nova-compute[75453]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 28 13:51:05 user nova-compute[75453]:     </secmodel>
Nov 28 13:51:05 user nova-compute[75453]:   </host>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='alpha'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>clipper</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='armv6l'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>spitz</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>nuri</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>kzm</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sx1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>z2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>tosa</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>n810</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>n800</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>terrier</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>midway</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>microbit</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>verdex</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>highbank</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>akita</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>connex</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>collie</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='armv7l'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>spitz</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>nuri</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>kzm</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sx1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>z2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>tosa</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>n810</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>n800</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>terrier</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>midway</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>microbit</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>verdex</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>highbank</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>akita</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>connex</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>collie</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='aarch64'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>spitz</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>nuri</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>kzm</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sx1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>z2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>tosa</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>n810</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>n800</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>terrier</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>midway</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>microbit</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>verdex</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>raspi3b</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>highbank</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>akita</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>connex</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>collie</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <acpi default='on' toggle='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='cris'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='i686'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>isapc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>microvm</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='kvm'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <pae/>
Nov 28 13:51:05 user nova-compute[75453]:       <nonpae/>
Nov 28 13:51:05 user nova-compute[75453]:       <acpi default='on' toggle='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:       <apic default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='m68k'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>an5206</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>q800</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>next-cube</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='microblaze'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='microblazeel'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='mips'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='16'>malta</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='mipsel'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='16'>malta</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='mips64'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='16'>malta</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>pica61</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>magnum</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='mips64el'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='16'>malta</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>pica61</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>magnum</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='16'>boston</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='ppc'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mac99</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>40p</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>taihu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='ppc64'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>taihu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>40p</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mac99</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='ppc64le'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>taihu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>40p</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>mac99</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='riscv32'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='8'>spike</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>opentitan</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='8'>virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='riscv64'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='8'>spike</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>shakti_c</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='8'>virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='s390x'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='sh4'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>shix</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>r2d</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='sh4eb'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>shix</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>r2d</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='sparc'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>SS-5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>SS-20</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>LX</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>SS-4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>SS-10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>Voyager</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='sparc64'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sun4u</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>niagara</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>sun4v</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='x86_64'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>64</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='1'>isapc</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>microvm</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='kvm'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <acpi default='on' toggle='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:       <apic default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='xtensa'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>sim</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>kc705</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>ml605</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>lx200</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>lx60</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]:   <guest>
Nov 28 13:51:05 user nova-compute[75453]:     <os_type>hvm</os_type>
Nov 28 13:51:05 user nova-compute[75453]:     <arch name='xtensaeb'>
Nov 28 13:51:05 user nova-compute[75453]:       <wordsize>32</wordsize>
Nov 28 13:51:05 user nova-compute[75453]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='4'>sim</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>kc705</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>ml605</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>virt</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>lx200</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>lx60</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 13:51:05 user nova-compute[75453]:       <domain type='qemu'/>
Nov 28 13:51:05 user nova-compute[75453]:     </arch>
Nov 28 13:51:05 user nova-compute[75453]:     <features>
Nov 28 13:51:05 user nova-compute[75453]:       <cpuselection/>
Nov 28 13:51:05 user nova-compute[75453]:       <deviceboot/>
Nov 28 13:51:05 user nova-compute[75453]:       <disksnapshot default='on' toggle='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     </features>
Nov 28 13:51:05 user nova-compute[75453]:   </guest>
Nov 28 13:51:05 user nova-compute[75453]: </capabilities>
Nov 28 13:51:05 user nova-compute[75453]: 
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 28 13:51:05 user nova-compute[75453]: <domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 13:51:05 user nova-compute[75453]:   <domain>kvm</domain>
Nov 28 13:51:05 user nova-compute[75453]:   <machine>pc-q35-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:   <arch>i686</arch>
Nov 28 13:51:05 user nova-compute[75453]:   <vcpu max='288'/>
Nov 28 13:51:05 user nova-compute[75453]:   <iothreads supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:   <os supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='firmware'/>
Nov 28 13:51:05 user nova-compute[75453]:     <loader supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>rom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pflash</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='readonly'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='secure'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </loader>
Nov 28 13:51:05 user nova-compute[75453]:   </os>
Nov 28 13:51:05 user nova-compute[75453]:   <cpu>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-passthrough' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='hostPassthroughMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='maximum' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='maximumMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-model' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <vendor>Intel</vendor>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ss'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='vmx'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pcid'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='hypervisor'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arat'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='umip'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='md-clear'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibpb'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibrs'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='erms'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='lm'/>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='custom' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>qemu64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>qemu32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>phenom</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>n270</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>kvm64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>coreduo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>core2duo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>athlon</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Westmere</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Snowridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Penryn</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G5</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G4</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G1</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Nehalem</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Rome</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Milan</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Dhyana</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cooperlake</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Conroe</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>486</model>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:   </cpu>
Nov 28 13:51:05 user nova-compute[75453]:   <memoryBacking supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='sourceType'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>file</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>anonymous</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>memfd</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:   </memoryBacking>
Nov 28 13:51:05 user nova-compute[75453]:   <devices>
Nov 28 13:51:05 user nova-compute[75453]:     <disk supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='diskDevice'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>disk</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cdrom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>floppy</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>lun</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='bus'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>fdc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sata</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </disk>
Nov 28 13:51:05 user nova-compute[75453]:     <graphics supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sdl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vnc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>spice</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egl-headless</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </graphics>
Nov 28 13:51:05 user nova-compute[75453]:     <video supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='modelType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cirrus</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vmvga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>qxl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>none</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>bochs</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ramfb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </video>
Nov 28 13:51:05 user nova-compute[75453]:     <hostdev supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='mode'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>subsystem</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='startupPolicy'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>default</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>mandatory</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>requisite</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>optional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='subsysType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pci</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='capsType'/>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='pciBackend'/>
Nov 28 13:51:05 user nova-compute[75453]:     </hostdev>
Nov 28 13:51:05 user nova-compute[75453]:     <rng supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>random</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egd</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>builtin</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </rng>
Nov 28 13:51:05 user nova-compute[75453]:     <filesystem supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='driverType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>path</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>handle</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtiofs</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </filesystem>
Nov 28 13:51:05 user nova-compute[75453]:     <tpm supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-tis</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-crb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>passthrough</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>emulator</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </tpm>
Nov 28 13:51:05 user nova-compute[75453]:   </devices>
Nov 28 13:51:05 user nova-compute[75453]:   <features>
Nov 28 13:51:05 user nova-compute[75453]:     <gic supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     <vmcoreinfo supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <genid supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backingStoreInput supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backup supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <sev supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:   </features>
Nov 28 13:51:05 user nova-compute[75453]: </domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:  {{(pid=75453) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 28 13:51:05 user nova-compute[75453]: <domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 13:51:05 user nova-compute[75453]:   <domain>kvm</domain>
Nov 28 13:51:05 user nova-compute[75453]:   <machine>pc-i440fx-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:   <arch>i686</arch>
Nov 28 13:51:05 user nova-compute[75453]:   <vcpu max='255'/>
Nov 28 13:51:05 user nova-compute[75453]:   <iothreads supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:   <os supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='firmware'/>
Nov 28 13:51:05 user nova-compute[75453]:     <loader supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>rom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pflash</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='readonly'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='secure'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </loader>
Nov 28 13:51:05 user nova-compute[75453]:   </os>
Nov 28 13:51:05 user nova-compute[75453]:   <cpu>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-passthrough' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='hostPassthroughMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='maximum' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='maximumMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-model' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <vendor>Intel</vendor>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ss'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='vmx'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pcid'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='hypervisor'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arat'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='umip'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='md-clear'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibpb'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibrs'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='erms'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='lm'/>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='custom' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>qemu64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>qemu32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>phenom</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>n270</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>kvm64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>coreduo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>core2duo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>athlon</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Westmere</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Snowridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Penryn</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G5</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G4</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G1</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Nehalem</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Rome</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Milan</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Dhyana</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cooperlake</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Conroe</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>486</model>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:   </cpu>
Nov 28 13:51:05 user nova-compute[75453]:   <memoryBacking supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='sourceType'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>file</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>anonymous</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>memfd</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:   </memoryBacking>
Nov 28 13:51:05 user nova-compute[75453]:   <devices>
Nov 28 13:51:05 user nova-compute[75453]:     <disk supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='diskDevice'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>disk</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cdrom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>floppy</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>lun</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='bus'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ide</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>fdc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sata</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </disk>
Nov 28 13:51:05 user nova-compute[75453]:     <graphics supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sdl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vnc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>spice</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egl-headless</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </graphics>
Nov 28 13:51:05 user nova-compute[75453]:     <video supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='modelType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cirrus</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vmvga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>qxl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>none</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>bochs</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ramfb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </video>
Nov 28 13:51:05 user nova-compute[75453]:     <hostdev supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='mode'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>subsystem</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='startupPolicy'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>default</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>mandatory</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>requisite</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>optional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='subsysType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pci</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='capsType'/>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='pciBackend'/>
Nov 28 13:51:05 user nova-compute[75453]:     </hostdev>
Nov 28 13:51:05 user nova-compute[75453]:     <rng supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>random</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egd</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>builtin</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </rng>
Nov 28 13:51:05 user nova-compute[75453]:     <filesystem supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='driverType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>path</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>handle</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtiofs</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </filesystem>
Nov 28 13:51:05 user nova-compute[75453]:     <tpm supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-tis</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-crb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>passthrough</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>emulator</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </tpm>
Nov 28 13:51:05 user nova-compute[75453]:   </devices>
Nov 28 13:51:05 user nova-compute[75453]:   <features>
Nov 28 13:51:05 user nova-compute[75453]:     <gic supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     <vmcoreinfo supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <genid supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backingStoreInput supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backup supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <sev supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:   </features>
Nov 28 13:51:05 user nova-compute[75453]: </domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:  {{(pid=75453) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 28 13:51:05 user nova-compute[75453]: <domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 13:51:05 user nova-compute[75453]:   <domain>kvm</domain>
Nov 28 13:51:05 user nova-compute[75453]:   <machine>pc-q35-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:   <arch>i686</arch>
Nov 28 13:51:05 user nova-compute[75453]:   <vcpu max='288'/>
Nov 28 13:51:05 user nova-compute[75453]:   <iothreads supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:   <os supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='firmware'/>
Nov 28 13:51:05 user nova-compute[75453]:     <loader supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>rom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pflash</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='readonly'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='secure'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </loader>
Nov 28 13:51:05 user nova-compute[75453]:   </os>
Nov 28 13:51:05 user nova-compute[75453]:   <cpu>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-passthrough' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='hostPassthroughMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='maximum' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='maximumMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-model' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <vendor>Intel</vendor>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ss'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='vmx'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pcid'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='hypervisor'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arat'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='umip'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='md-clear'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibpb'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibrs'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='erms'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='lm'/>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='custom' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>qemu64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>qemu32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>phenom</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>n270</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>kvm64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>coreduo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>core2duo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>athlon</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Westmere</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Snowridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Penryn</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G5</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G4</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G1</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Nehalem</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Rome</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Milan</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Dhyana</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cooperlake</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Conroe</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>486</model>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:   </cpu>
Nov 28 13:51:05 user nova-compute[75453]:   <memoryBacking supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='sourceType'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>file</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>anonymous</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>memfd</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:   </memoryBacking>
Nov 28 13:51:05 user nova-compute[75453]:   <devices>
Nov 28 13:51:05 user nova-compute[75453]:     <disk supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='diskDevice'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>disk</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cdrom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>floppy</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>lun</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='bus'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>fdc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sata</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </disk>
Nov 28 13:51:05 user nova-compute[75453]:     <graphics supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sdl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vnc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>spice</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egl-headless</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </graphics>
Nov 28 13:51:05 user nova-compute[75453]:     <video supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='modelType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cirrus</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vmvga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>qxl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>none</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>bochs</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ramfb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </video>
Nov 28 13:51:05 user nova-compute[75453]:     <hostdev supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='mode'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>subsystem</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='startupPolicy'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>default</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>mandatory</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>requisite</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>optional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='subsysType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pci</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='capsType'/>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='pciBackend'/>
Nov 28 13:51:05 user nova-compute[75453]:     </hostdev>
Nov 28 13:51:05 user nova-compute[75453]:     <rng supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>random</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egd</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>builtin</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </rng>
Nov 28 13:51:05 user nova-compute[75453]:     <filesystem supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='driverType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>path</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>handle</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtiofs</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </filesystem>
Nov 28 13:51:05 user nova-compute[75453]:     <tpm supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-tis</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-crb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>passthrough</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>emulator</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </tpm>
Nov 28 13:51:05 user nova-compute[75453]:   </devices>
Nov 28 13:51:05 user nova-compute[75453]:   <features>
Nov 28 13:51:05 user nova-compute[75453]:     <gic supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     <vmcoreinfo supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <genid supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backingStoreInput supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backup supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <sev supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:   </features>
Nov 28 13:51:05 user nova-compute[75453]: </domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:  {{(pid=75453) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 28 13:51:05 user nova-compute[75453]: <domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 13:51:05 user nova-compute[75453]:   <domain>kvm</domain>
Nov 28 13:51:05 user nova-compute[75453]:   <machine>pc-i440fx-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:   <arch>i686</arch>
Nov 28 13:51:05 user nova-compute[75453]:   <vcpu max='255'/>
Nov 28 13:51:05 user nova-compute[75453]:   <iothreads supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:   <os supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='firmware'/>
Nov 28 13:51:05 user nova-compute[75453]:     <loader supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>rom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pflash</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='readonly'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='secure'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </loader>
Nov 28 13:51:05 user nova-compute[75453]:   </os>
Nov 28 13:51:05 user nova-compute[75453]:   <cpu>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-passthrough' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='hostPassthroughMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='maximum' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='maximumMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-model' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <vendor>Intel</vendor>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ss'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='vmx'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pcid'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='hypervisor'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arat'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='umip'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='md-clear'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibpb'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibrs'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='erms'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='lm'/>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='custom' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>qemu64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>qemu32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>phenom</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>n270</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>kvm64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>coreduo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>core2duo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>athlon</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Westmere</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Snowridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Penryn</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G5</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G4</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G1</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Nehalem</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Rome</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Milan</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Dhyana</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cooperlake</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Conroe</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>486</model>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:   </cpu>
Nov 28 13:51:05 user nova-compute[75453]:   <memoryBacking supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='sourceType'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>file</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>anonymous</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>memfd</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:   </memoryBacking>
Nov 28 13:51:05 user nova-compute[75453]:   <devices>
Nov 28 13:51:05 user nova-compute[75453]:     <disk supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='diskDevice'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>disk</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cdrom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>floppy</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>lun</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='bus'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ide</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>fdc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sata</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </disk>
Nov 28 13:51:05 user nova-compute[75453]:     <graphics supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sdl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vnc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>spice</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egl-headless</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </graphics>
Nov 28 13:51:05 user nova-compute[75453]:     <video supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='modelType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cirrus</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vmvga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>qxl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>none</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>bochs</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ramfb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </video>
Nov 28 13:51:05 user nova-compute[75453]:     <hostdev supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='mode'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>subsystem</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='startupPolicy'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>default</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>mandatory</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>requisite</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>optional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='subsysType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pci</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='capsType'/>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='pciBackend'/>
Nov 28 13:51:05 user nova-compute[75453]:     </hostdev>
Nov 28 13:51:05 user nova-compute[75453]:     <rng supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>random</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egd</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>builtin</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </rng>
Nov 28 13:51:05 user nova-compute[75453]:     <filesystem supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='driverType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>path</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>handle</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtiofs</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </filesystem>
Nov 28 13:51:05 user nova-compute[75453]:     <tpm supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-tis</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-crb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>passthrough</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>emulator</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </tpm>
Nov 28 13:51:05 user nova-compute[75453]:   </devices>
Nov 28 13:51:05 user nova-compute[75453]:   <features>
Nov 28 13:51:05 user nova-compute[75453]:     <gic supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     <vmcoreinfo supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <genid supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backingStoreInput supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backup supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <sev supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:   </features>
Nov 28 13:51:05 user nova-compute[75453]: </domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:  {{(pid=75453) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 28 13:51:05 user nova-compute[75453]: <domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 13:51:05 user nova-compute[75453]:   <domain>kvm</domain>
Nov 28 13:51:05 user nova-compute[75453]:   <machine>pc-q35-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:   <arch>x86_64</arch>
Nov 28 13:51:05 user nova-compute[75453]:   <vcpu max='288'/>
Nov 28 13:51:05 user nova-compute[75453]:   <iothreads supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:   <os supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='firmware'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>efi</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:     <loader supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>rom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pflash</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='readonly'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='secure'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </loader>
Nov 28 13:51:05 user nova-compute[75453]:   </os>
Nov 28 13:51:05 user nova-compute[75453]:   <cpu>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-passthrough' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='hostPassthroughMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='maximum' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='maximumMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-model' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <vendor>Intel</vendor>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ss'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='vmx'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pcid'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='hypervisor'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arat'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='umip'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='md-clear'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='invtsc'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibpb'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibrs'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='rsba'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='erms'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='custom' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>qemu64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>qemu32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>phenom</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>n270</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>coreduo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>core2duo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>athlon</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Westmere</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Snowridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Penryn</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G5</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G4</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Opteron_G1</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Nehalem</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Rome</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Milan</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Dhyana</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cooperlake</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Conroe</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>486</model>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:   </cpu>
Nov 28 13:51:05 user nova-compute[75453]:   <memoryBacking supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='sourceType'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>file</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>anonymous</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>memfd</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:   </memoryBacking>
Nov 28 13:51:05 user nova-compute[75453]:   <devices>
Nov 28 13:51:05 user nova-compute[75453]:     <disk supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='diskDevice'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>disk</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cdrom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>floppy</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>lun</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='bus'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>fdc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sata</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </disk>
Nov 28 13:51:05 user nova-compute[75453]:     <graphics supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sdl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vnc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>spice</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egl-headless</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </graphics>
Nov 28 13:51:05 user nova-compute[75453]:     <video supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='modelType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cirrus</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vmvga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>qxl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>none</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>bochs</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ramfb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </video>
Nov 28 13:51:05 user nova-compute[75453]:     <hostdev supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='mode'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>subsystem</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='startupPolicy'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>default</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>mandatory</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>requisite</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>optional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='subsysType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pci</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='capsType'/>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='pciBackend'/>
Nov 28 13:51:05 user nova-compute[75453]:     </hostdev>
Nov 28 13:51:05 user nova-compute[75453]:     <rng supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>random</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egd</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>builtin</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </rng>
Nov 28 13:51:05 user nova-compute[75453]:     <filesystem supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='driverType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>path</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>handle</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtiofs</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </filesystem>
Nov 28 13:51:05 user nova-compute[75453]:     <tpm supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-tis</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-crb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>passthrough</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>emulator</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </tpm>
Nov 28 13:51:05 user nova-compute[75453]:   </devices>
Nov 28 13:51:05 user nova-compute[75453]:   <features>
Nov 28 13:51:05 user nova-compute[75453]:     <gic supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     <vmcoreinfo supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <genid supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backingStoreInput supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backup supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <sev supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:   </features>
Nov 28 13:51:05 user nova-compute[75453]: </domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:  {{(pid=75453) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 28 13:51:05 user nova-compute[75453]: <domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 13:51:05 user nova-compute[75453]:   <domain>kvm</domain>
Nov 28 13:51:05 user nova-compute[75453]:   <machine>pc-i440fx-6.2</machine>
Nov 28 13:51:05 user nova-compute[75453]:   <arch>x86_64</arch>
Nov 28 13:51:05 user nova-compute[75453]:   <vcpu max='255'/>
Nov 28 13:51:05 user nova-compute[75453]:   <iothreads supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:   <os supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='firmware'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>efi</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:     <loader supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>rom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pflash</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='readonly'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='secure'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </loader>
Nov 28 13:51:05 user nova-compute[75453]:   </os>
Nov 28 13:51:05 user nova-compute[75453]:   <cpu>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-passthrough' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='hostPassthroughMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='maximum' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='maximumMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-model' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <vendor>Intel</vendor>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ss'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='vmx'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pcid'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='hypervisor'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arat'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='umip'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='md-clear'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='invtsc'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibpb'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibrs'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='rsba'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='erms'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='custom' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>qemu64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>qemu32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>phenom</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>n270</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>coreduo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>core2duo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>athlon</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Westmere</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Snowridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Penryn</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G5</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G4</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Opteron_G1</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Nehalem</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Rome</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Milan</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Dhyana</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cooperlake</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Conroe</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>486</model>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:   </cpu>
Nov 28 13:51:05 user nova-compute[75453]:   <memoryBacking supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='sourceType'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>file</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>anonymous</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>memfd</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:   </memoryBacking>
Nov 28 13:51:05 user nova-compute[75453]:   <devices>
Nov 28 13:51:05 user nova-compute[75453]:     <disk supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='diskDevice'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>disk</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cdrom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>floppy</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>lun</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='bus'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ide</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>fdc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sata</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </disk>
Nov 28 13:51:05 user nova-compute[75453]:     <graphics supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sdl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vnc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>spice</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egl-headless</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </graphics>
Nov 28 13:51:05 user nova-compute[75453]:     <video supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='modelType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cirrus</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vmvga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>qxl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>none</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>bochs</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ramfb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </video>
Nov 28 13:51:05 user nova-compute[75453]:     <hostdev supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='mode'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>subsystem</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='startupPolicy'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>default</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>mandatory</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>requisite</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>optional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='subsysType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pci</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='capsType'/>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='pciBackend'/>
Nov 28 13:51:05 user nova-compute[75453]:     </hostdev>
Nov 28 13:51:05 user nova-compute[75453]:     <rng supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>random</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egd</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>builtin</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </rng>
Nov 28 13:51:05 user nova-compute[75453]:     <filesystem supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='driverType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>path</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>handle</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtiofs</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </filesystem>
Nov 28 13:51:05 user nova-compute[75453]:     <tpm supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-tis</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-crb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>passthrough</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>emulator</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </tpm>
Nov 28 13:51:05 user nova-compute[75453]:   </devices>
Nov 28 13:51:05 user nova-compute[75453]:   <features>
Nov 28 13:51:05 user nova-compute[75453]:     <gic supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     <vmcoreinfo supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <genid supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backingStoreInput supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backup supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <sev supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:   </features>
Nov 28 13:51:05 user nova-compute[75453]: </domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:  {{(pid=75453) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 28 13:51:05 user nova-compute[75453]: <domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 13:51:05 user nova-compute[75453]:   <domain>kvm</domain>
Nov 28 13:51:05 user nova-compute[75453]:   <machine>pc-q35-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:   <arch>x86_64</arch>
Nov 28 13:51:05 user nova-compute[75453]:   <vcpu max='288'/>
Nov 28 13:51:05 user nova-compute[75453]:   <iothreads supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:   <os supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='firmware'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>efi</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:     <loader supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>rom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pflash</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='readonly'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='secure'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </loader>
Nov 28 13:51:05 user nova-compute[75453]:   </os>
Nov 28 13:51:05 user nova-compute[75453]:   <cpu>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-passthrough' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='hostPassthroughMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='maximum' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='maximumMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-model' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <vendor>Intel</vendor>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ss'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='vmx'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pcid'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='hypervisor'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arat'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='umip'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='md-clear'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='invtsc'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibpb'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibrs'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='rsba'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='erms'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='custom' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>qemu64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>qemu32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>phenom</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>n270</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>coreduo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>core2duo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>athlon</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Westmere</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Snowridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Penryn</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G5</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G4</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Opteron_G1</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Nehalem</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Rome</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Milan</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Dhyana</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cooperlake</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Conroe</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>486</model>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:   </cpu>
Nov 28 13:51:05 user nova-compute[75453]:   <memoryBacking supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='sourceType'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>file</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>anonymous</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>memfd</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:   </memoryBacking>
Nov 28 13:51:05 user nova-compute[75453]:   <devices>
Nov 28 13:51:05 user nova-compute[75453]:     <disk supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='diskDevice'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>disk</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cdrom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>floppy</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>lun</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='bus'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>fdc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sata</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </disk>
Nov 28 13:51:05 user nova-compute[75453]:     <graphics supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sdl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vnc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>spice</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egl-headless</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </graphics>
Nov 28 13:51:05 user nova-compute[75453]:     <video supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='modelType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cirrus</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vmvga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>qxl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>none</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>bochs</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ramfb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </video>
Nov 28 13:51:05 user nova-compute[75453]:     <hostdev supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='mode'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>subsystem</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='startupPolicy'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>default</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>mandatory</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>requisite</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>optional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='subsysType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pci</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='capsType'/>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='pciBackend'/>
Nov 28 13:51:05 user nova-compute[75453]:     </hostdev>
Nov 28 13:51:05 user nova-compute[75453]:     <rng supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>random</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egd</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>builtin</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </rng>
Nov 28 13:51:05 user nova-compute[75453]:     <filesystem supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='driverType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>path</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>handle</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtiofs</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </filesystem>
Nov 28 13:51:05 user nova-compute[75453]:     <tpm supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-tis</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-crb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>passthrough</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>emulator</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </tpm>
Nov 28 13:51:05 user nova-compute[75453]:   </devices>
Nov 28 13:51:05 user nova-compute[75453]:   <features>
Nov 28 13:51:05 user nova-compute[75453]:     <gic supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     <vmcoreinfo supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <genid supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backingStoreInput supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backup supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <sev supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:   </features>
Nov 28 13:51:05 user nova-compute[75453]: </domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:  {{(pid=75453) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 28 13:51:05 user nova-compute[75453]: <domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 13:51:05 user nova-compute[75453]:   <domain>kvm</domain>
Nov 28 13:51:05 user nova-compute[75453]:   <machine>pc-i440fx-jammy</machine>
Nov 28 13:51:05 user nova-compute[75453]:   <arch>x86_64</arch>
Nov 28 13:51:05 user nova-compute[75453]:   <vcpu max='255'/>
Nov 28 13:51:05 user nova-compute[75453]:   <iothreads supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:   <os supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='firmware'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>efi</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:     <loader supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>rom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pflash</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='readonly'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>yes</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='secure'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>no</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </loader>
Nov 28 13:51:05 user nova-compute[75453]:   </os>
Nov 28 13:51:05 user nova-compute[75453]:   <cpu>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-passthrough' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='hostPassthroughMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='maximum' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='maximumMigratable'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>on</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>off</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='host-model' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <vendor>Intel</vendor>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ss'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='vmx'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pcid'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='hypervisor'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arat'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='umip'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='md-clear'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='invtsc'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibpb'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='ibrs'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-stibp'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='rsba'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='erms'/>
Nov 28 13:51:05 user nova-compute[75453]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:     <mode name='custom' supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>qemu64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>qemu32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>phenom</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>pentium</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>n270</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm64</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>kvm32</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>coreduo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>core2duo</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>athlon</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Westmere</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Snowridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Skylake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>SandyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Penryn</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G5</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G4</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G3</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Opteron_G2</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Opteron_G1</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Nehalem</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>IvyBridge</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Icelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Haswell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Rome</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-Milan</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>EPYC</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Dhyana</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cooperlake</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>Conroe</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='no'>Broadwell</model>
Nov 28 13:51:05 user nova-compute[75453]:       <model usable='yes'>486</model>
Nov 28 13:51:05 user nova-compute[75453]:     </mode>
Nov 28 13:51:05 user nova-compute[75453]:   </cpu>
Nov 28 13:51:05 user nova-compute[75453]:   <memoryBacking supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:     <enum name='sourceType'>
Nov 28 13:51:05 user nova-compute[75453]:       <value>file</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>anonymous</value>
Nov 28 13:51:05 user nova-compute[75453]:       <value>memfd</value>
Nov 28 13:51:05 user nova-compute[75453]:     </enum>
Nov 28 13:51:05 user nova-compute[75453]:   </memoryBacking>
Nov 28 13:51:05 user nova-compute[75453]:   <devices>
Nov 28 13:51:05 user nova-compute[75453]:     <disk supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='diskDevice'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>disk</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cdrom</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>floppy</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>lun</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='bus'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ide</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>fdc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sata</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </disk>
Nov 28 13:51:05 user nova-compute[75453]:     <graphics supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='type'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>sdl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vnc</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>spice</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egl-headless</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </graphics>
Nov 28 13:51:05 user nova-compute[75453]:     <video supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='modelType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>cirrus</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>vmvga</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>qxl</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>none</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>bochs</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>ramfb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </video>
Nov 28 13:51:05 user nova-compute[75453]:     <hostdev supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='mode'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>subsystem</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='startupPolicy'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>default</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>mandatory</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>requisite</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>optional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='subsysType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>usb</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>pci</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>scsi</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='capsType'/>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='pciBackend'/>
Nov 28 13:51:05 user nova-compute[75453]:     </hostdev>
Nov 28 13:51:05 user nova-compute[75453]:     <rng supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtio-non-transitional</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>random</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>egd</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>builtin</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </rng>
Nov 28 13:51:05 user nova-compute[75453]:     <filesystem supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='driverType'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>path</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>handle</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>virtiofs</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </filesystem>
Nov 28 13:51:05 user nova-compute[75453]:     <tpm supported='yes'>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='model'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-tis</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>tpm-crb</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:       <enum name='backendModel'>
Nov 28 13:51:05 user nova-compute[75453]:         <value>passthrough</value>
Nov 28 13:51:05 user nova-compute[75453]:         <value>emulator</value>
Nov 28 13:51:05 user nova-compute[75453]:       </enum>
Nov 28 13:51:05 user nova-compute[75453]:     </tpm>
Nov 28 13:51:05 user nova-compute[75453]:   </devices>
Nov 28 13:51:05 user nova-compute[75453]:   <features>
Nov 28 13:51:05 user nova-compute[75453]:     <gic supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:     <vmcoreinfo supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <genid supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backingStoreInput supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <backup supported='yes'/>
Nov 28 13:51:05 user nova-compute[75453]:     <sev supported='no'/>
Nov 28 13:51:05 user nova-compute[75453]:   </features>
Nov 28 13:51:05 user nova-compute[75453]: </domainCapabilities>
Nov 28 13:51:05 user nova-compute[75453]:  {{(pid=75453) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75453) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75453) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Checking secure boot support for host arch (x86_64) {{(pid=75453) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 13:51:05 user nova-compute[75453]: INFO nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Secure Boot support detected
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] cpu compare xml: <cpu match="exact">
Nov 28 13:51:05 user nova-compute[75453]:   <model>Nehalem</model>
Nov 28 13:51:05 user nova-compute[75453]: </cpu>
Nov 28 13:51:05 user nova-compute[75453]:  {{(pid=75453) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 28 13:51:05 user nova-compute[75453]: INFO nova.virt.node [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Generated node identity 4cacb5b9-170e-4610-a8bb-0f50950f49d5
Nov 28 13:51:05 user nova-compute[75453]: INFO nova.virt.node [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Wrote node identity 4cacb5b9-170e-4610-a8bb-0f50950f49d5 to /opt/stack/data/nova/compute_id
Nov 28 13:51:05 user nova-compute[75453]: WARNING nova.compute.manager [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Compute nodes ['4cacb5b9-170e-4610-a8bb-0f50950f49d5'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 28 13:51:05 user nova-compute[75453]: INFO nova.compute.manager [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 28 13:51:05 user nova-compute[75453]: WARNING nova.compute.manager [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 13:51:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:51:05 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 13:51:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:51:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Hypervisor/Node resource view: name=user free_ram=10978MB free_disk=26.1282958984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:51:06 user nova-compute[75453]: WARNING nova.compute.resource_tracker [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] No compute node record for user:4cacb5b9-170e-4610-a8bb-0f50950f49d5: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4cacb5b9-170e-4610-a8bb-0f50950f49d5 could not be found.
Nov 28 13:51:06 user nova-compute[75453]: INFO nova.compute.resource_tracker [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Compute node record created for user:user with uuid: 4cacb5b9-170e-4610-a8bb-0f50950f49d5
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 13:51:06 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] [req-e6eeb1b2-9a7f-44c7-985c-467330d56529] Created resource provider record via placement API for resource provider with UUID 4cacb5b9-170e-4610-a8bb-0f50950f49d5 and name user.
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75453) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 28 13:51:06 user nova-compute[75453]: INFO nova.virt.libvirt.host [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] kernel doesn't support AMD SEV
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Libvirt baseline CPU <cpu>
Nov 28 13:51:06 user nova-compute[75453]:   <arch>x86_64</arch>
Nov 28 13:51:06 user nova-compute[75453]:   <model>Nehalem</model>
Nov 28 13:51:06 user nova-compute[75453]:   <vendor>Intel</vendor>
Nov 28 13:51:06 user nova-compute[75453]:   <topology sockets="6" cores="1" threads="1"/>
Nov 28 13:51:06 user nova-compute[75453]: </cpu>
Nov 28 13:51:06 user nova-compute[75453]:  {{(pid=75453) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Updated inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Updating resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 generation from 0 to 1 during operation: update_inventory {{(pid=75453) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Updating resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 generation from 1 to 2 during operation: update_traits {{(pid=75453) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.service [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Creating RPC server for service compute {{(pid=75453) start /opt/stack/nova/nova/service.py:182}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.service [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] Join ServiceGroup membership for this service compute {{(pid=75453) start /opt/stack/nova/nova/service.py:199}}
Nov 28 13:51:06 user nova-compute[75453]: DEBUG nova.servicegroup.drivers.db [None req-25d86531-fd92-4cb9-afaf-c868971f6676 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75453) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 28 13:51:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_power_states {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 13:51:57 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:51:57 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:51:57 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=10440MB free_disk=26.03204345703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 13:51:57 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 13:51:58 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:51:58 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:51:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 13:51:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 13:52:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:52:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=10351MB free_disk=26.097309112548828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:52:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 13:52:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:52:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:52:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:53:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 13:53:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:53:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:53:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=10373MB free_disk=25.85079574584961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 13:53:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:53:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:53:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 13:53:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 13:53:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 13:53:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:53:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:53:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 13:54:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:54:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:54:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 13:54:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:54:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:54:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9681MB free_disk=25.877994537353516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 13:54:58 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:54:59 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:54:59 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 13:54:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 13:55:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 13:55:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 13:55:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 13:55:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "48dd0221-4935-4ee2-9958-90a748fe5255" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "48dd0221-4935-4ee2-9958-90a748fe5255" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:08 user nova-compute[75453]: DEBUG nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:55:09 user nova-compute[75453]: INFO nova.compute.claims [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Claim successful on node user
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.121s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:55:09 user nova-compute[75453]: INFO nova.compute.claims [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Claim successful on node user
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.network.neutron [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:55:09 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:55:09 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Creating image(s)
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "/opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "/opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "/opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:55:09 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.policy [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:55:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG nova.policy [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:55:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Creating image(s)
Nov 28 13:55:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "/opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "/opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "/opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d.part --force-share --output=json" returned: 0 in 0.230s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG nova.virt.images [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] 0d03e2fc-4d16-4fd7-9616-933da07dcf7b was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d.part /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d.part /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d.converted" returned: 0 in 0.280s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d.converted --force-share --output=json" returned: 0 in 0.300s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.419s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:11 user nova-compute[75453]: INFO oslo.privsep.daemon [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpym4lcmyx/privsep.sock']
Nov 28 13:55:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.654s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:11 user sudo[84850]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpym4lcmyx/privsep.sock
Nov 28 13:55:11 user sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 13:55:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Successfully created port: ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:55:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Successfully created port: 56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:55:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:55:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:55:12 user nova-compute[75453]: INFO nova.compute.claims [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Claim successful on node user
Nov 28 13:55:12 user sudo[84850]: pam_unix(sudo:session): session closed for user root
Nov 28 13:55:12 user nova-compute[75453]: INFO oslo.privsep.daemon [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Spawned new privsep daemon via rootwrap
Nov 28 13:55:12 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 13:55:12 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 13:55:12 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 28 13:55:12 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84861
Nov 28 13:55:12 user nova-compute[75453]: WARNING oslo_privsep.priv_context [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] privsep daemon already running
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.209s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.network.neutron [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:55:13 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk 1073741824" returned: 0 in 0.052s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.208s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:55:13 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Creating image(s)
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "/opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "/opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.164s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.policy [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.167s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk 1073741824" returned: 0 in 0.111s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.047s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Cannot resize image /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Ensure instance console log exists: /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.191s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk 1073741824" returned: 0 in 0.046s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Cannot resize image /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Ensure instance console log exists: /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.199s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Cannot resize image /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Ensure instance console log exists: /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:14 user nova-compute[75453]: DEBUG nova.network.neutron [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Successfully updated port: ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquired lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG nova.compute.manager [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received event network-changed-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG nova.compute.manager [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Refreshing instance network info cache due to event network-changed-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Acquiring lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Successfully updated port: 56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquired lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:55:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Updating instance_info_cache with network_info: [{"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Releasing lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Instance network_info: |[{"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Acquired lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.neutron [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Refreshing network info cache for port ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Start _get_guest_xml network_info=[{"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:55:16 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:16 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1356482257',display_name='tempest-ServersNegativeTestJSON-server-1356482257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1356482257',id=1,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f9642956daa4507a3b6791bcd41d9d3',ramdisk_id='',reservation_id='r-3ru08h5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2071230602',owner_user_name='tempest-ServersNegativeTestJSON-2071230602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:10Z,user_data=None,user_id='237e50c8ccfa49169a1bdca99f46e616',uuid=48dd0221-4935-4ee2-9958-90a748fe5255,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converting VIF {"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0a:d8,bridge_name='br-int',has_traffic_filtering=True,id=ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea53315f-4a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.objects.instance [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lazy-loading 'pci_devices' on Instance uuid 48dd0221-4935-4ee2-9958-90a748fe5255 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:55:16 user nova-compute[75453]:   <uuid>48dd0221-4935-4ee2-9958-90a748fe5255</uuid>
Nov 28 13:55:16 user nova-compute[75453]:   <name>instance-00000001</name>
Nov 28 13:55:16 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:55:16 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:55:16 user nova-compute[75453]:   <metadata>
Nov 28 13:55:16 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:55:16 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:name>tempest-ServersNegativeTestJSON-server-1356482257</nova:name>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:55:16</nova:creationTime>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:55:16 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:55:16 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:owner>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:user uuid="237e50c8ccfa49169a1bdca99f46e616">tempest-ServersNegativeTestJSON-2071230602-project-member</nova:user>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:project uuid="0f9642956daa4507a3b6791bcd41d9d3">tempest-ServersNegativeTestJSON-2071230602</nova:project>
Nov 28 13:55:16 user nova-compute[75453]:       </nova:owner>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:ports>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:port uuid="ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f">
Nov 28 13:55:16 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 13:55:16 user nova-compute[75453]:         </nova:port>
Nov 28 13:55:16 user nova-compute[75453]:       </nova:ports>
Nov 28 13:55:16 user nova-compute[75453]:     </nova:instance>
Nov 28 13:55:16 user nova-compute[75453]:   </metadata>
Nov 28 13:55:16 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:55:16 user nova-compute[75453]:     <system>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="serial">48dd0221-4935-4ee2-9958-90a748fe5255</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="uuid">48dd0221-4935-4ee2-9958-90a748fe5255</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:55:16 user nova-compute[75453]:     </system>
Nov 28 13:55:16 user nova-compute[75453]:   </sysinfo>
Nov 28 13:55:16 user nova-compute[75453]:   <os>
Nov 28 13:55:16 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:55:16 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:55:16 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:55:16 user nova-compute[75453]:   </os>
Nov 28 13:55:16 user nova-compute[75453]:   <features>
Nov 28 13:55:16 user nova-compute[75453]:     <acpi/>
Nov 28 13:55:16 user nova-compute[75453]:     <apic/>
Nov 28 13:55:16 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:55:16 user nova-compute[75453]:   </features>
Nov 28 13:55:16 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:55:16 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:55:16 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:55:16 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:55:16 user nova-compute[75453]:   </clock>
Nov 28 13:55:16 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:55:16 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:55:16 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:55:16 user nova-compute[75453]:   </cpu>
Nov 28 13:55:16 user nova-compute[75453]:   <devices>
Nov 28 13:55:16 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:55:16 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:55:16 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk"/>
Nov 28 13:55:16 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:55:16 user nova-compute[75453]:     </disk>
Nov 28 13:55:16 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:55:16 user nova-compute[75453]:       <mac address="fa:16:3e:5d:0a:d8"/>
Nov 28 13:55:16 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:16 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:55:16 user nova-compute[75453]:       <target dev="tapea53315f-4a"/>
Nov 28 13:55:16 user nova-compute[75453]:     </interface>
Nov 28 13:55:16 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:55:16 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/console.log" append="off"/>
Nov 28 13:55:16 user nova-compute[75453]:     </serial>
Nov 28 13:55:16 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:55:16 user nova-compute[75453]:     <video>
Nov 28 13:55:16 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:16 user nova-compute[75453]:     </video>
Nov 28 13:55:16 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:55:16 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:55:16 user nova-compute[75453]:     </rng>
Nov 28 13:55:16 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:55:16 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:55:16 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:55:16 user nova-compute[75453]:     </memballoon>
Nov 28 13:55:16 user nova-compute[75453]:   </devices>
Nov 28 13:55:16 user nova-compute[75453]: </domain>
Nov 28 13:55:16 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1356482257',display_name='tempest-ServersNegativeTestJSON-server-1356482257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1356482257',id=1,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f9642956daa4507a3b6791bcd41d9d3',ramdisk_id='',reservation_id='r-3ru08h5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2071230602',owner_user_name='tempest-ServersNegativeTestJSON-2071230602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:10Z,user_data=None,user_id='237e50c8ccfa49169a1bdca99f46e616',uuid=48dd0221-4935-4ee2-9958-90a748fe5255,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converting VIF {"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0a:d8,bridge_name='br-int',has_traffic_filtering=True,id=ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea53315f-4a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG os_vif [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0a:d8,bridge_name='br-int',has_traffic_filtering=True,id=ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea53315f-4a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Created schema index Interface.name {{(pid=75453) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Created schema index Port.name {{(pid=75453) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Created schema index Bridge.name {{(pid=75453) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [POLLOUT] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Successfully created port: 36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11c8554c-5f0a-5f30-9217-2863d8fb6823', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:16 user nova-compute[75453]: INFO oslo.privsep.daemon [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_ra3xmi8/privsep.sock']
Nov 28 13:55:16 user sudo[85000]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_ra3xmi8/privsep.sock
Nov 28 13:55:16 user sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating instance_info_cache with network_info: [{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Releasing lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance network_info: |[{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Start _get_guest_xml network_info=[{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:55:16 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:16 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1751161168',display_name='tempest-AttachVolumeTestJSON-server-1751161168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1751161168',id=2,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw==',key_name='tempest-keypair-605550184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-hiprfdzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=10e135e2-a52b-437c-adb6-3fb81daf17e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.objects.instance [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'pci_devices' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:55:16 user nova-compute[75453]:   <uuid>10e135e2-a52b-437c-adb6-3fb81daf17e4</uuid>
Nov 28 13:55:16 user nova-compute[75453]:   <name>instance-00000002</name>
Nov 28 13:55:16 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:55:16 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:55:16 user nova-compute[75453]:   <metadata>
Nov 28 13:55:16 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:55:16 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeTestJSON-server-1751161168</nova:name>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:55:16</nova:creationTime>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:55:16 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:55:16 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:owner>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:user uuid="c38a4b08cd204e2a9b313a7740df3f3e">tempest-AttachVolumeTestJSON-15045878-project-member</nova:user>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:project uuid="56b5137584864cf094d60d14e6f0ab0f">tempest-AttachVolumeTestJSON-15045878</nova:project>
Nov 28 13:55:16 user nova-compute[75453]:       </nova:owner>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:55:16 user nova-compute[75453]:       <nova:ports>
Nov 28 13:55:16 user nova-compute[75453]:         <nova:port uuid="56d8de7f-0f8a-4f2e-8890-405ec6cb9294">
Nov 28 13:55:16 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 13:55:16 user nova-compute[75453]:         </nova:port>
Nov 28 13:55:16 user nova-compute[75453]:       </nova:ports>
Nov 28 13:55:16 user nova-compute[75453]:     </nova:instance>
Nov 28 13:55:16 user nova-compute[75453]:   </metadata>
Nov 28 13:55:16 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:55:16 user nova-compute[75453]:     <system>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="serial">10e135e2-a52b-437c-adb6-3fb81daf17e4</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="uuid">10e135e2-a52b-437c-adb6-3fb81daf17e4</entry>
Nov 28 13:55:16 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:55:16 user nova-compute[75453]:     </system>
Nov 28 13:55:16 user nova-compute[75453]:   </sysinfo>
Nov 28 13:55:16 user nova-compute[75453]:   <os>
Nov 28 13:55:16 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:55:16 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:55:16 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:55:16 user nova-compute[75453]:   </os>
Nov 28 13:55:16 user nova-compute[75453]:   <features>
Nov 28 13:55:16 user nova-compute[75453]:     <acpi/>
Nov 28 13:55:16 user nova-compute[75453]:     <apic/>
Nov 28 13:55:16 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:55:16 user nova-compute[75453]:   </features>
Nov 28 13:55:16 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:55:16 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:55:16 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:55:16 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:55:16 user nova-compute[75453]:   </clock>
Nov 28 13:55:16 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:55:16 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:55:16 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:55:16 user nova-compute[75453]:   </cpu>
Nov 28 13:55:16 user nova-compute[75453]:   <devices>
Nov 28 13:55:16 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:55:16 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:55:16 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk"/>
Nov 28 13:55:16 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:55:16 user nova-compute[75453]:     </disk>
Nov 28 13:55:16 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:55:16 user nova-compute[75453]:       <mac address="fa:16:3e:bd:18:5b"/>
Nov 28 13:55:16 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:16 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:55:16 user nova-compute[75453]:       <target dev="tap56d8de7f-0f"/>
Nov 28 13:55:16 user nova-compute[75453]:     </interface>
Nov 28 13:55:16 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:55:16 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/console.log" append="off"/>
Nov 28 13:55:16 user nova-compute[75453]:     </serial>
Nov 28 13:55:16 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:55:16 user nova-compute[75453]:     <video>
Nov 28 13:55:16 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:16 user nova-compute[75453]:     </video>
Nov 28 13:55:16 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:55:16 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:55:16 user nova-compute[75453]:     </rng>
Nov 28 13:55:16 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:55:16 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:55:16 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:55:16 user nova-compute[75453]:     </memballoon>
Nov 28 13:55:16 user nova-compute[75453]:   </devices>
Nov 28 13:55:16 user nova-compute[75453]: </domain>
Nov 28 13:55:16 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1751161168',display_name='tempest-AttachVolumeTestJSON-server-1751161168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1751161168',id=2,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw==',key_name='tempest-keypair-605550184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-hiprfdzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=10e135e2-a52b-437c-adb6-3fb81daf17e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG os_vif [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a205e63-6362-5451-bb4e-c5573b4e2282', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:17 user nova-compute[75453]: DEBUG nova.network.neutron [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Updated VIF entry in instance network info cache for port ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:55:17 user nova-compute[75453]: DEBUG nova.network.neutron [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Updating instance_info_cache with network_info: [{"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0bb37675-87b2-4e8b-b0a3-170b1a92a2e4 req-e4978d07-a60e-4c9b-bf0d-34ebe3c6a7e2 service nova] Releasing lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:17 user nova-compute[75453]: DEBUG nova.compute.manager [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-changed-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:17 user nova-compute[75453]: DEBUG nova.compute.manager [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Refreshing instance network info cache due to event network-changed-56d8de7f-0f8a-4f2e-8890-405ec6cb9294. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:55:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Acquiring lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Acquired lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:17 user nova-compute[75453]: DEBUG nova.network.neutron [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Refreshing network info cache for port 56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:55:17 user sudo[85000]: pam_unix(sudo:session): session closed for user root
Nov 28 13:55:17 user nova-compute[75453]: INFO oslo.privsep.daemon [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Spawned new privsep daemon via rootwrap
Nov 28 13:55:17 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 13:55:17 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 13:55:17 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 28 13:55:17 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85003
Nov 28 13:55:17 user nova-compute[75453]: WARNING oslo_privsep.priv_context [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] privsep daemon already running
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56d8de7f-0f, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56d8de7f-0f, col_values=(('qos', UUID('c4692ef2-9eb9-4c16-be0f-5ff470b6e7af')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56d8de7f-0f, col_values=(('external_ids', {'iface-id': '56d8de7f-0f8a-4f2e-8890-405ec6cb9294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:18:5b', 'vm-uuid': '10e135e2-a52b-437c-adb6-3fb81daf17e4'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:18 user nova-compute[75453]: INFO os_vif [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f')
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea53315f-4a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea53315f-4a, col_values=(('qos', UUID('332f65e9-e5fd-4850-94f8-2e8d7cc01cba')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea53315f-4a, col_values=(('external_ids', {'iface-id': 'ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:0a:d8', 'vm-uuid': '48dd0221-4935-4ee2-9958-90a748fe5255'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:18 user nova-compute[75453]: INFO os_vif [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:0a:d8,bridge_name='br-int',has_traffic_filtering=True,id=ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea53315f-4a')
Nov 28 13:55:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No VIF found with MAC fa:16:3e:bd:18:5b, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] No VIF found with MAC fa:16:3e:5d:0a:d8, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Successfully updated port: 36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquired lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:55:19 user nova-compute[75453]: DEBUG nova.network.neutron [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updated VIF entry in instance network info cache for port 56d8de7f-0f8a-4f2e-8890-405ec6cb9294. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:55:19 user nova-compute[75453]: DEBUG nova.network.neutron [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating instance_info_cache with network_info: [{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-be5c13fa-fb01-4f12-a08a-748db557b240 req-0d77c568-8e2b-4d04-89f4-c803762d2e4f service nova] Releasing lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-changed-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Refreshing instance network info cache due to event network-changed-36d6817d-5a86-4e22-90cd-adfe2b3f176e. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:55:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] Acquiring lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.network.neutron [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance_info_cache with network_info: [{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Releasing lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance network_info: |[{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] Acquired lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.network.neutron [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Refreshing network info cache for port 36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Start _get_guest_xml network_info=[{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:55:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-370204766',display_name='tempest-ServerActionsTestOtherB-server-370204766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-370204766',id=3,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg==',key_name='tempest-keypair-2095208703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d326de84f8224cef95e650bd92e7198f',ramdisk_id='',reservation_id='r-0iqcbio7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1799325713',owner_user_name='tempest-ServerActionsTestOtherB-1799325713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14da9954e4fc44deb3c603165b10cf66',uuid=9a32cb51-7b87-4d9b-9e94-72cb60f4371f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converting VIF {"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.objects.instance [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a32cb51-7b87-4d9b-9e94-72cb60f4371f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:55:20 user nova-compute[75453]:   <uuid>9a32cb51-7b87-4d9b-9e94-72cb60f4371f</uuid>
Nov 28 13:55:20 user nova-compute[75453]:   <name>instance-00000003</name>
Nov 28 13:55:20 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:55:20 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:55:20 user nova-compute[75453]:   <metadata>
Nov 28 13:55:20 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:55:20 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:55:20 user nova-compute[75453]:       <nova:name>tempest-ServerActionsTestOtherB-server-370204766</nova:name>
Nov 28 13:55:20 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:55:20</nova:creationTime>
Nov 28 13:55:20 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:55:20 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:55:20 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:55:20 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:55:20 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:55:20 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:55:20 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:55:20 user nova-compute[75453]:       <nova:owner>
Nov 28 13:55:20 user nova-compute[75453]:         <nova:user uuid="14da9954e4fc44deb3c603165b10cf66">tempest-ServerActionsTestOtherB-1799325713-project-member</nova:user>
Nov 28 13:55:20 user nova-compute[75453]:         <nova:project uuid="d326de84f8224cef95e650bd92e7198f">tempest-ServerActionsTestOtherB-1799325713</nova:project>
Nov 28 13:55:20 user nova-compute[75453]:       </nova:owner>
Nov 28 13:55:20 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:55:20 user nova-compute[75453]:       <nova:ports>
Nov 28 13:55:20 user nova-compute[75453]:         <nova:port uuid="36d6817d-5a86-4e22-90cd-adfe2b3f176e">
Nov 28 13:55:20 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 13:55:20 user nova-compute[75453]:         </nova:port>
Nov 28 13:55:20 user nova-compute[75453]:       </nova:ports>
Nov 28 13:55:20 user nova-compute[75453]:     </nova:instance>
Nov 28 13:55:20 user nova-compute[75453]:   </metadata>
Nov 28 13:55:20 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:55:20 user nova-compute[75453]:     <system>
Nov 28 13:55:20 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:55:20 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:55:20 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:55:20 user nova-compute[75453]:       <entry name="serial">9a32cb51-7b87-4d9b-9e94-72cb60f4371f</entry>
Nov 28 13:55:20 user nova-compute[75453]:       <entry name="uuid">9a32cb51-7b87-4d9b-9e94-72cb60f4371f</entry>
Nov 28 13:55:20 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:55:20 user nova-compute[75453]:     </system>
Nov 28 13:55:20 user nova-compute[75453]:   </sysinfo>
Nov 28 13:55:20 user nova-compute[75453]:   <os>
Nov 28 13:55:20 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:55:20 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:55:20 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:55:20 user nova-compute[75453]:   </os>
Nov 28 13:55:20 user nova-compute[75453]:   <features>
Nov 28 13:55:20 user nova-compute[75453]:     <acpi/>
Nov 28 13:55:20 user nova-compute[75453]:     <apic/>
Nov 28 13:55:20 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:55:20 user nova-compute[75453]:   </features>
Nov 28 13:55:20 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:55:20 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:55:20 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:55:20 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:55:20 user nova-compute[75453]:   </clock>
Nov 28 13:55:20 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:55:20 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:55:20 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:55:20 user nova-compute[75453]:   </cpu>
Nov 28 13:55:20 user nova-compute[75453]:   <devices>
Nov 28 13:55:20 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:55:20 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:55:20 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk"/>
Nov 28 13:55:20 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:55:20 user nova-compute[75453]:     </disk>
Nov 28 13:55:20 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:55:20 user nova-compute[75453]:       <mac address="fa:16:3e:c0:6b:2f"/>
Nov 28 13:55:20 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:20 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:55:20 user nova-compute[75453]:       <target dev="tap36d6817d-5a"/>
Nov 28 13:55:20 user nova-compute[75453]:     </interface>
Nov 28 13:55:20 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:55:20 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/console.log" append="off"/>
Nov 28 13:55:20 user nova-compute[75453]:     </serial>
Nov 28 13:55:20 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:55:20 user nova-compute[75453]:     <video>
Nov 28 13:55:20 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:20 user nova-compute[75453]:     </video>
Nov 28 13:55:20 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:55:20 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:55:20 user nova-compute[75453]:     </rng>
Nov 28 13:55:20 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:55:20 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:55:20 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:55:20 user nova-compute[75453]:     </memballoon>
Nov 28 13:55:20 user nova-compute[75453]:   </devices>
Nov 28 13:55:20 user nova-compute[75453]: </domain>
Nov 28 13:55:20 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-370204766',display_name='tempest-ServerActionsTestOtherB-server-370204766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-370204766',id=3,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg==',key_name='tempest-keypair-2095208703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d326de84f8224cef95e650bd92e7198f',ramdisk_id='',reservation_id='r-0iqcbio7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1799325713',owner_user_name='tempest-ServerActionsTestOtherB-1799325713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14da9954e4fc44deb3c603165b10cf66',uuid=9a32cb51-7b87-4d9b-9e94-72cb60f4371f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converting VIF {"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG os_vif [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16449ee4-b347-5841-87ae-acfdb3982287', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36d6817d-5a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36d6817d-5a, col_values=(('qos', UUID('f243c4ca-30b5-48b8-b385-0d90c588281d')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36d6817d-5a, col_values=(('external_ids', {'iface-id': '36d6817d-5a86-4e22-90cd-adfe2b3f176e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:6b:2f', 'vm-uuid': '9a32cb51-7b87-4d9b-9e94-72cb60f4371f'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:20 user nova-compute[75453]: INFO os_vif [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a')
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] No VIF found with MAC fa:16:3e:c0:6b:2f, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG nova.network.neutron [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updated VIF entry in instance network info cache for port 36d6817d-5a86-4e22-90cd-adfe2b3f176e. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG nova.network.neutron [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance_info_cache with network_info: [{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ef4082c6-c940-4c76-a566-b09fc3e429d9 req-2947797e-c8f9-4014-bb75-c7de6e151ff7 service nova] Releasing lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "949a3612-5042-420f-9911-ec641017d399" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:21 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:55:21 user nova-compute[75453]: INFO nova.compute.claims [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Claim successful on node user
Nov 28 13:55:21 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:55:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:55:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG nova.policy [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:55:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Creating image(s)
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "/opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "/opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "/opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.206s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk 1073741824" returned: 0 in 0.050s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Cannot resize image /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Ensure instance console log exists: /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:23 user nova-compute[75453]: DEBUG nova.network.neutron [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Successfully created port: c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:55:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance spawned successfully.
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:24 user nova-compute[75453]: INFO nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Took 13.87 seconds to spawn the instance on the hypervisor.
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:55:24 user nova-compute[75453]: INFO nova.compute.manager [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Took 15.42 seconds to build instance.
Nov 28 13:55:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27244b6c-adca-4086-8f9b-916155993ec2 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.670s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:55:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Instance spawned successfully.
Nov 28 13:55:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:25 user nova-compute[75453]: INFO nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Took 15.45 seconds to spawn the instance on the hypervisor.
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:25 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance spawned successfully.
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Successfully updated port: c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:55:25 user nova-compute[75453]: INFO nova.compute.manager [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Took 16.48 seconds to build instance.
Nov 28 13:55:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquired lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-763caab4-d406-46e9-b85f-df74cfa2ee12 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "48dd0221-4935-4ee2-9958-90a748fe5255" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.793s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:55:25 user nova-compute[75453]: INFO nova.compute.claims [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Claim successful on node user
Nov 28 13:55:25 user nova-compute[75453]: INFO nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Took 11.91 seconds to spawn the instance on the hypervisor.
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received event network-changed-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Refreshing instance network info cache due to event network-changed-c4432eb7-3703-49b9-afd1-534fdd4065b4. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] Acquiring lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:55:25 user nova-compute[75453]: INFO nova.compute.manager [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Took 13.08 seconds to build instance.
Nov 28 13:55:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e99843c2-32bd-49ad-b514-4e049629a228 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.240s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:55:25 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:55:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Updating instance_info_cache with network_info: [{"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Releasing lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Instance network_info: |[{"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] Acquired lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Refreshing network info cache for port c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Start _get_guest_xml network_info=[{"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.policy [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9f9b1cc04a4417ebf987aa99a18e6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b572682eb94af0b628ee30a16d9225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received event network-vif-plugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] Acquiring lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] No waiting events found dispatching network-vif-plugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:26 user nova-compute[75453]: WARNING nova.compute.manager [req-e2b1856f-4240-4659-980f-ef174fc33bec req-9befdfb9-a923-4ede-a992-649a158de4d6 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received unexpected event network-vif-plugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance with vm_state active and task_state None.
Nov 28 13:55:26 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:26 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:55:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Creating image(s)
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "/opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "/opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "/opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-462278016',display_name='tempest-AttachVolumeNegativeTest-server-462278016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-462278016',id=4,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEurKFzowQcp2NLIRyfnyakH2lqBVHuoHwmKYo7DloY5HmCUCDn4ZANWNR9sovmCPmqCPQf1ocz3QVX5DnNCT72PukED7dIYoq4XGJEjcy1YchSPVrm0tfF5cMKIzfF5ug==',key_name='tempest-keypair-2064566278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-foaz04oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=949a3612-5042-420f-9911-ec641017d399,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=c4432eb7-3703-49b9-afd1-534fdd4065b4,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4432eb7-37') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.objects.instance [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'pci_devices' on Instance uuid 949a3612-5042-420f-9911-ec641017d399 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:55:26 user nova-compute[75453]:   <uuid>949a3612-5042-420f-9911-ec641017d399</uuid>
Nov 28 13:55:26 user nova-compute[75453]:   <name>instance-00000004</name>
Nov 28 13:55:26 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:55:26 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:55:26 user nova-compute[75453]:   <metadata>
Nov 28 13:55:26 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:55:26 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:55:26 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeNegativeTest-server-462278016</nova:name>
Nov 28 13:55:26 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:55:26</nova:creationTime>
Nov 28 13:55:26 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:55:26 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:55:26 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:55:26 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:55:26 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:55:26 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:55:26 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:55:26 user nova-compute[75453]:       <nova:owner>
Nov 28 13:55:26 user nova-compute[75453]:         <nova:user uuid="2afdefdd832241779d405f4763c3b37e">tempest-AttachVolumeNegativeTest-180653455-project-member</nova:user>
Nov 28 13:55:26 user nova-compute[75453]:         <nova:project uuid="b710669f2d5c41378e2c63765f2846ed">tempest-AttachVolumeNegativeTest-180653455</nova:project>
Nov 28 13:55:26 user nova-compute[75453]:       </nova:owner>
Nov 28 13:55:26 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:55:26 user nova-compute[75453]:       <nova:ports>
Nov 28 13:55:26 user nova-compute[75453]:         <nova:port uuid="c4432eb7-3703-49b9-afd1-534fdd4065b4">
Nov 28 13:55:26 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 13:55:26 user nova-compute[75453]:         </nova:port>
Nov 28 13:55:26 user nova-compute[75453]:       </nova:ports>
Nov 28 13:55:26 user nova-compute[75453]:     </nova:instance>
Nov 28 13:55:26 user nova-compute[75453]:   </metadata>
Nov 28 13:55:26 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:55:26 user nova-compute[75453]:     <system>
Nov 28 13:55:26 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:55:26 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:55:26 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:55:26 user nova-compute[75453]:       <entry name="serial">949a3612-5042-420f-9911-ec641017d399</entry>
Nov 28 13:55:26 user nova-compute[75453]:       <entry name="uuid">949a3612-5042-420f-9911-ec641017d399</entry>
Nov 28 13:55:26 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:55:26 user nova-compute[75453]:     </system>
Nov 28 13:55:26 user nova-compute[75453]:   </sysinfo>
Nov 28 13:55:26 user nova-compute[75453]:   <os>
Nov 28 13:55:26 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:55:26 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:55:26 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:55:26 user nova-compute[75453]:   </os>
Nov 28 13:55:26 user nova-compute[75453]:   <features>
Nov 28 13:55:26 user nova-compute[75453]:     <acpi/>
Nov 28 13:55:26 user nova-compute[75453]:     <apic/>
Nov 28 13:55:26 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:55:26 user nova-compute[75453]:   </features>
Nov 28 13:55:26 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:55:26 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:55:26 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:55:26 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:55:26 user nova-compute[75453]:   </clock>
Nov 28 13:55:26 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:55:26 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:55:26 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:55:26 user nova-compute[75453]:   </cpu>
Nov 28 13:55:26 user nova-compute[75453]:   <devices>
Nov 28 13:55:26 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:55:26 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:55:26 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk"/>
Nov 28 13:55:26 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:55:26 user nova-compute[75453]:     </disk>
Nov 28 13:55:26 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:55:26 user nova-compute[75453]:       <mac address="fa:16:3e:83:c2:36"/>
Nov 28 13:55:26 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:26 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:55:26 user nova-compute[75453]:       <target dev="tapc4432eb7-37"/>
Nov 28 13:55:26 user nova-compute[75453]:     </interface>
Nov 28 13:55:26 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:55:26 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/console.log" append="off"/>
Nov 28 13:55:26 user nova-compute[75453]:     </serial>
Nov 28 13:55:26 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:55:26 user nova-compute[75453]:     <video>
Nov 28 13:55:26 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:26 user nova-compute[75453]:     </video>
Nov 28 13:55:26 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:55:26 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:55:26 user nova-compute[75453]:     </rng>
Nov 28 13:55:26 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:55:26 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:55:26 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:55:26 user nova-compute[75453]:     </memballoon>
Nov 28 13:55:26 user nova-compute[75453]:   </devices>
Nov 28 13:55:26 user nova-compute[75453]: </domain>
Nov 28 13:55:26 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-462278016',display_name='tempest-AttachVolumeNegativeTest-server-462278016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-462278016',id=4,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEurKFzowQcp2NLIRyfnyakH2lqBVHuoHwmKYo7DloY5HmCUCDn4ZANWNR9sovmCPmqCPQf1ocz3QVX5DnNCT72PukED7dIYoq4XGJEjcy1YchSPVrm0tfF5cMKIzfF5ug==',key_name='tempest-keypair-2064566278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-foaz04oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=949a3612-5042-420f-9911-ec641017d399,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=c4432eb7-3703-49b9-afd1-534fdd4065b4,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4432eb7-37') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG os_vif [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=c4432eb7-3703-49b9-afd1-534fdd4065b4,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4432eb7-37') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6475275-7355-570d-9fce-d5b9e9675e49', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4432eb7-37, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4432eb7-37, col_values=(('qos', UUID('d085f039-415c-440c-a869-d845648cc35e')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4432eb7-37, col_values=(('external_ids', {'iface-id': 'c4432eb7-3703-49b9-afd1-534fdd4065b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:c2:36', 'vm-uuid': '949a3612-5042-420f-9911-ec641017d399'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:26 user nova-compute[75453]: INFO os_vif [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=c4432eb7-3703-49b9-afd1-534fdd4065b4,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4432eb7-37')
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:55:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No VIF found with MAC fa:16:3e:83:c2:36, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.365s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.255s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk 1073741824" returned: 0 in 0.079s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.236s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Cannot resize image /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Ensure instance console log exists: /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.018s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received event network-vif-plugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Acquiring lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] No waiting events found dispatching network-vif-plugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:28 user nova-compute[75453]: WARNING nova.compute.manager [req-d8fe6d42-a6ce-4865-9b14-6681135a3ffc req-683920b0-8df1-43d1-ac7e-6d65415a29da service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received unexpected event network-vif-plugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance with vm_state active and task_state None.
Nov 28 13:55:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Updated VIF entry in instance network info cache for port c4432eb7-3703-49b9-afd1-534fdd4065b4. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:55:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Updating instance_info_cache with network_info: [{"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-687a4ed9-c843-4232-b6eb-7a50d6b83dae req-7ae83529-ec14-43e8-bd23-41496ad88139 service nova] Releasing lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:29 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Successfully created port: b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:55:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:55:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:55:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:32 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 949a3612-5042-420f-9911-ec641017d399] Instance spawned successfully.
Nov 28 13:55:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:55:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:32 user nova-compute[75453]: INFO nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Took 9.88 seconds to spawn the instance on the hypervisor.
Nov 28 13:55:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:55:32 user nova-compute[75453]: INFO nova.compute.manager [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Took 10.87 seconds to build instance.
Nov 28 13:55:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-836ba320-2600-4cf5-a813-952bf1c525d7 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.032s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Successfully updated port: b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:55:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquired lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:55:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:55:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-changed-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Refreshing instance network info cache due to event network-changed-b0710703-b905-47cd-bf04-c07eb065364e. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:55:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] Acquiring lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Updating instance_info_cache with network_info: [{"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Releasing lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Instance network_info: |[{"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] Acquired lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.network.neutron [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Refreshing network info cache for port b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Start _get_guest_xml network_info=[{"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:55:34 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:34 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2036539272',display_name='tempest-VolumesAdminNegativeTest-server-2036539272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2036539272',id=5,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJBP38LrSeECryJxQCpE/WiHIW+aDF65IhTudWGMrLGYW0xa/psYC/7M2yDVYu5HJRMMQSALCu3mXia21ivoTFH56dqp27J4aTQ35ItkZ8oC2jGFWLCbfMiEmkHahxHTQ==',key_name='tempest-keypair-776308576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75b572682eb94af0b628ee30a16d9225',ramdisk_id='',reservation_id='r-882ky2o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-963761222',owner_user_name='tempest-VolumesAdminNegativeTest-963761222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9f9b1cc04a4417ebf987aa99a18e6a7',uuid=3907babd-71af-4fca-8ad7-4a7dae1710d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converting VIF {"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:eb:14,bridge_name='br-int',has_traffic_filtering=True,id=b0710703-b905-47cd-bf04-c07eb065364e,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0710703-b9') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lazy-loading 'pci_devices' on Instance uuid 3907babd-71af-4fca-8ad7-4a7dae1710d6 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:55:34 user nova-compute[75453]:   <uuid>3907babd-71af-4fca-8ad7-4a7dae1710d6</uuid>
Nov 28 13:55:34 user nova-compute[75453]:   <name>instance-00000005</name>
Nov 28 13:55:34 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:55:34 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:55:34 user nova-compute[75453]:   <metadata>
Nov 28 13:55:34 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:55:34 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:55:34 user nova-compute[75453]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2036539272</nova:name>
Nov 28 13:55:34 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:55:34</nova:creationTime>
Nov 28 13:55:34 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:55:34 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:55:34 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:55:34 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:55:34 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:55:34 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:55:34 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:55:34 user nova-compute[75453]:       <nova:owner>
Nov 28 13:55:34 user nova-compute[75453]:         <nova:user uuid="c9f9b1cc04a4417ebf987aa99a18e6a7">tempest-VolumesAdminNegativeTest-963761222-project-member</nova:user>
Nov 28 13:55:34 user nova-compute[75453]:         <nova:project uuid="75b572682eb94af0b628ee30a16d9225">tempest-VolumesAdminNegativeTest-963761222</nova:project>
Nov 28 13:55:34 user nova-compute[75453]:       </nova:owner>
Nov 28 13:55:34 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:55:34 user nova-compute[75453]:       <nova:ports>
Nov 28 13:55:34 user nova-compute[75453]:         <nova:port uuid="b0710703-b905-47cd-bf04-c07eb065364e">
Nov 28 13:55:34 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 13:55:34 user nova-compute[75453]:         </nova:port>
Nov 28 13:55:34 user nova-compute[75453]:       </nova:ports>
Nov 28 13:55:34 user nova-compute[75453]:     </nova:instance>
Nov 28 13:55:34 user nova-compute[75453]:   </metadata>
Nov 28 13:55:34 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:55:34 user nova-compute[75453]:     <system>
Nov 28 13:55:34 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:55:34 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:55:34 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:55:34 user nova-compute[75453]:       <entry name="serial">3907babd-71af-4fca-8ad7-4a7dae1710d6</entry>
Nov 28 13:55:34 user nova-compute[75453]:       <entry name="uuid">3907babd-71af-4fca-8ad7-4a7dae1710d6</entry>
Nov 28 13:55:34 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:55:34 user nova-compute[75453]:     </system>
Nov 28 13:55:34 user nova-compute[75453]:   </sysinfo>
Nov 28 13:55:34 user nova-compute[75453]:   <os>
Nov 28 13:55:34 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:55:34 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:55:34 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:55:34 user nova-compute[75453]:   </os>
Nov 28 13:55:34 user nova-compute[75453]:   <features>
Nov 28 13:55:34 user nova-compute[75453]:     <acpi/>
Nov 28 13:55:34 user nova-compute[75453]:     <apic/>
Nov 28 13:55:34 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:55:34 user nova-compute[75453]:   </features>
Nov 28 13:55:34 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:55:34 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:55:34 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:55:34 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:55:34 user nova-compute[75453]:   </clock>
Nov 28 13:55:34 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:55:34 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:55:34 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:55:34 user nova-compute[75453]:   </cpu>
Nov 28 13:55:34 user nova-compute[75453]:   <devices>
Nov 28 13:55:34 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:55:34 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:55:34 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk"/>
Nov 28 13:55:34 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:55:34 user nova-compute[75453]:     </disk>
Nov 28 13:55:34 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:55:34 user nova-compute[75453]:       <mac address="fa:16:3e:35:eb:14"/>
Nov 28 13:55:34 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:34 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:55:34 user nova-compute[75453]:       <target dev="tapb0710703-b9"/>
Nov 28 13:55:34 user nova-compute[75453]:     </interface>
Nov 28 13:55:34 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:55:34 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/console.log" append="off"/>
Nov 28 13:55:34 user nova-compute[75453]:     </serial>
Nov 28 13:55:34 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:55:34 user nova-compute[75453]:     <video>
Nov 28 13:55:34 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:34 user nova-compute[75453]:     </video>
Nov 28 13:55:34 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:55:34 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:55:34 user nova-compute[75453]:     </rng>
Nov 28 13:55:34 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:55:34 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:55:34 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:55:34 user nova-compute[75453]:     </memballoon>
Nov 28 13:55:34 user nova-compute[75453]:   </devices>
Nov 28 13:55:34 user nova-compute[75453]: </domain>
Nov 28 13:55:34 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2036539272',display_name='tempest-VolumesAdminNegativeTest-server-2036539272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2036539272',id=5,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJBP38LrSeECryJxQCpE/WiHIW+aDF65IhTudWGMrLGYW0xa/psYC/7M2yDVYu5HJRMMQSALCu3mXia21ivoTFH56dqp27J4aTQ35ItkZ8oC2jGFWLCbfMiEmkHahxHTQ==',key_name='tempest-keypair-776308576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75b572682eb94af0b628ee30a16d9225',ramdisk_id='',reservation_id='r-882ky2o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-963761222',owner_user_name='tempest-VolumesAdminNegativeTest-963761222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9f9b1cc04a4417ebf987aa99a18e6a7',uuid=3907babd-71af-4fca-8ad7-4a7dae1710d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converting VIF {"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:eb:14,bridge_name='br-int',has_traffic_filtering=True,id=b0710703-b905-47cd-bf04-c07eb065364e,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0710703-b9') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG os_vif [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:eb:14,bridge_name='br-int',has_traffic_filtering=True,id=b0710703-b905-47cd-bf04-c07eb065364e,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0710703-b9') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31f1a32b-2fb2-577a-a74d-66873e631b67', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0710703-b9, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0710703-b9, col_values=(('qos', UUID('d07609da-fa8b-439c-a1e1-3519f7265106')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0710703-b9, col_values=(('external_ids', {'iface-id': 'b0710703-b905-47cd-bf04-c07eb065364e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:eb:14', 'vm-uuid': '3907babd-71af-4fca-8ad7-4a7dae1710d6'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:34 user nova-compute[75453]: INFO os_vif [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:eb:14,bridge_name='br-int',has_traffic_filtering=True,id=b0710703-b905-47cd-bf04-c07eb065364e,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0710703-b9')
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] No VIF found with MAC fa:16:3e:35:eb:14, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:55:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:35 user nova-compute[75453]: WARNING nova.compute.manager [req-c9075fa5-d258-4dc8-b2e1-f244a97730fe req-35e73b55-ba0a-41a4-995d-6803fca657d9 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state active and task_state None.
Nov 28 13:55:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Updated VIF entry in instance network info cache for port b0710703-b905-47cd-bf04-c07eb065364e. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:55:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Updating instance_info_cache with network_info: [{"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5ceeb586-8335-4771-ac63-fdbf9c76b3a3 req-3890af92-2976-4ac4-bea9-905f18cbd16c service nova] Releasing lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:37 user nova-compute[75453]: DEBUG nova.compute.manager [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:37 user nova-compute[75453]: DEBUG nova.compute.manager [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:37 user nova-compute[75453]: WARNING nova.compute.manager [req-61afe674-4230-4979-9adf-dd413f577166 req-aa8e4270-746f-43fa-8fdc-0a71a6753f27 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state active and task_state None.
Nov 28 13:55:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:55:39 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Instance spawned successfully.
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:39 user nova-compute[75453]: INFO nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Took 13.32 seconds to spawn the instance on the hypervisor.
Nov 28 13:55:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:55:40 user nova-compute[75453]: INFO nova.compute.manager [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Took 14.85 seconds to build instance.
Nov 28 13:55:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b14cf70-dfad-4e4c-be49-f3fce0c48ce8 tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.091s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:41 user nova-compute[75453]: DEBUG nova.compute.manager [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:41 user nova-compute[75453]: DEBUG nova.compute.manager [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:41 user nova-compute[75453]: WARNING nova.compute.manager [req-901061b9-1e15-458e-892a-010a10e4c4c5 req-c32ba63e-b596-4a6f-8a85-9d5028452ef9 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state active and task_state None.
Nov 28 13:55:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:44 user nova-compute[75453]: WARNING nova.compute.manager [req-6f69fe94-c857-4673-be5f-5f572b468fed req-90fbc8ae-325b-455e-b420-26987962df9e service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state active and task_state None.
Nov 28 13:55:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:55:44 user nova-compute[75453]: INFO nova.compute.claims [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Claim successful on node user
Nov 28 13:55:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:44 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:55:45 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.policy [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:55:45 user nova-compute[75453]: INFO nova.compute.claims [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Claim successful on node user
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:55:45 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Creating image(s)
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.289s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.233s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Successfully created port: 885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.654s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk 1073741824" returned: 0 in 0.083s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:55:46 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.policy [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecf1fd2414db4fb9a5006cc8f5441745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65587be998440ed8f615dcb2f8f0d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.325s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:55:46 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Creating image(s)
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "/opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "/opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "/opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Cannot resize image /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Ensure instance console log exists: /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.202s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.235s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk 1073741824" returned: 0 in 0.062s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.237s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Successfully created port: 1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Cannot resize image /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Ensure instance console log exists: /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Successfully updated port: 885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquired lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-changed-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Refreshing instance network info cache due to event network-changed-885d9ccd-4b72-4063-b89a-ae6a3466a743. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] Acquiring lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:47 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updating instance_info_cache with network_info: [{"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Releasing lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Instance network_info: |[{"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] Acquired lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.network.neutron [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Refreshing network info cache for port 885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Start _get_guest_xml network_info=[{"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:55:48 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:48 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535040327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535040327',id=6,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ==',key_name='tempest-keypair-1885537121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eb964406b0844ce997488844a2b0676',ramdisk_id='',reservation_id='r-nhd1qkbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1487095452',owner_user_name='tempest-TaggedAttachmentsTest-1487095452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c126fcfb0e4747ccaaf814d508698c55',uuid=a9a21b61-5815-47ed-adac-040b1fc8e33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converting VIF {"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=885d9ccd-4b72-4063-b89a-ae6a3466a743,network=Network(d123dddc-c4d6-4211-a9d5-6579178447f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885d9ccd-4b') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lazy-loading 'pci_devices' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:55:48 user nova-compute[75453]:   <uuid>a9a21b61-5815-47ed-adac-040b1fc8e33a</uuid>
Nov 28 13:55:48 user nova-compute[75453]:   <name>instance-00000006</name>
Nov 28 13:55:48 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:55:48 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:55:48 user nova-compute[75453]:   <metadata>
Nov 28 13:55:48 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:55:48 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:55:48 user nova-compute[75453]:       <nova:name>tempest-device-tagging-server-535040327</nova:name>
Nov 28 13:55:48 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:55:48</nova:creationTime>
Nov 28 13:55:48 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:55:48 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:55:48 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:55:48 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:55:48 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:55:48 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:55:48 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:55:48 user nova-compute[75453]:       <nova:owner>
Nov 28 13:55:48 user nova-compute[75453]:         <nova:user uuid="c126fcfb0e4747ccaaf814d508698c55">tempest-TaggedAttachmentsTest-1487095452-project-member</nova:user>
Nov 28 13:55:48 user nova-compute[75453]:         <nova:project uuid="0eb964406b0844ce997488844a2b0676">tempest-TaggedAttachmentsTest-1487095452</nova:project>
Nov 28 13:55:48 user nova-compute[75453]:       </nova:owner>
Nov 28 13:55:48 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:55:48 user nova-compute[75453]:       <nova:ports>
Nov 28 13:55:48 user nova-compute[75453]:         <nova:port uuid="885d9ccd-4b72-4063-b89a-ae6a3466a743">
Nov 28 13:55:48 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 13:55:48 user nova-compute[75453]:         </nova:port>
Nov 28 13:55:48 user nova-compute[75453]:       </nova:ports>
Nov 28 13:55:48 user nova-compute[75453]:     </nova:instance>
Nov 28 13:55:48 user nova-compute[75453]:   </metadata>
Nov 28 13:55:48 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:55:48 user nova-compute[75453]:     <system>
Nov 28 13:55:48 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:55:48 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:55:48 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:55:48 user nova-compute[75453]:       <entry name="serial">a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:55:48 user nova-compute[75453]:       <entry name="uuid">a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:55:48 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:55:48 user nova-compute[75453]:     </system>
Nov 28 13:55:48 user nova-compute[75453]:   </sysinfo>
Nov 28 13:55:48 user nova-compute[75453]:   <os>
Nov 28 13:55:48 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:55:48 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:55:48 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:55:48 user nova-compute[75453]:   </os>
Nov 28 13:55:48 user nova-compute[75453]:   <features>
Nov 28 13:55:48 user nova-compute[75453]:     <acpi/>
Nov 28 13:55:48 user nova-compute[75453]:     <apic/>
Nov 28 13:55:48 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:55:48 user nova-compute[75453]:   </features>
Nov 28 13:55:48 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:55:48 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:55:48 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:55:48 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:55:48 user nova-compute[75453]:   </clock>
Nov 28 13:55:48 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:55:48 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:55:48 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:55:48 user nova-compute[75453]:   </cpu>
Nov 28 13:55:48 user nova-compute[75453]:   <devices>
Nov 28 13:55:48 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:55:48 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:55:48 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk"/>
Nov 28 13:55:48 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:55:48 user nova-compute[75453]:     </disk>
Nov 28 13:55:48 user nova-compute[75453]:     <disk type="file" device="cdrom">
Nov 28 13:55:48 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 13:55:48 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.config"/>
Nov 28 13:55:48 user nova-compute[75453]:       <target dev="hda" bus="ide"/>
Nov 28 13:55:48 user nova-compute[75453]:     </disk>
Nov 28 13:55:48 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:55:48 user nova-compute[75453]:       <mac address="fa:16:3e:c2:b7:b3"/>
Nov 28 13:55:48 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:48 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:55:48 user nova-compute[75453]:       <target dev="tap885d9ccd-4b"/>
Nov 28 13:55:48 user nova-compute[75453]:     </interface>
Nov 28 13:55:48 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:55:48 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log" append="off"/>
Nov 28 13:55:48 user nova-compute[75453]:     </serial>
Nov 28 13:55:48 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:55:48 user nova-compute[75453]:     <video>
Nov 28 13:55:48 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:48 user nova-compute[75453]:     </video>
Nov 28 13:55:48 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:55:48 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:55:48 user nova-compute[75453]:     </rng>
Nov 28 13:55:48 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:55:48 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:55:48 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:55:48 user nova-compute[75453]:     </memballoon>
Nov 28 13:55:48 user nova-compute[75453]:   </devices>
Nov 28 13:55:48 user nova-compute[75453]: </domain>
Nov 28 13:55:48 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535040327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535040327',id=6,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ==',key_name='tempest-keypair-1885537121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eb964406b0844ce997488844a2b0676',ramdisk_id='',reservation_id='r-nhd1qkbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1487095452',owner_user_name='tempest-TaggedAttachmentsTest-1487095452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c126fcfb0e4747ccaaf814d508698c55',uuid=a9a21b61-5815-47ed-adac-040b1fc8e33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converting VIF {"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=885d9ccd-4b72-4063-b89a-ae6a3466a743,network=Network(d123dddc-c4d6-4211-a9d5-6579178447f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885d9ccd-4b') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG os_vif [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=885d9ccd-4b72-4063-b89a-ae6a3466a743,network=Network(d123dddc-c4d6-4211-a9d5-6579178447f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885d9ccd-4b') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82d30dc1-d13d-5bf6-8aad-868715ed427f', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap885d9ccd-4b, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap885d9ccd-4b, col_values=(('qos', UUID('80cd11cc-db84-4e51-b4eb-f4eb8cd46cac')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap885d9ccd-4b, col_values=(('external_ids', {'iface-id': '885d9ccd-4b72-4063-b89a-ae6a3466a743', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:b7:b3', 'vm-uuid': 'a9a21b61-5815-47ed-adac-040b1fc8e33a'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:48 user nova-compute[75453]: INFO os_vif [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=885d9ccd-4b72-4063-b89a-ae6a3466a743,network=Network(d123dddc-c4d6-4211-a9d5-6579178447f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885d9ccd-4b')
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] No BDM found with device name hda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:55:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] No VIF found with MAC fa:16:3e:c2:b7:b3, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:55:48 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Using config drive
Nov 28 13:55:49 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Successfully updated port: 1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:55:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquired lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:49 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:55:49 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:55:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received event network-changed-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Refreshing instance network info cache due to event network-changed-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:55:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] Acquiring lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.network.neutron [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updated VIF entry in instance network info cache for port 885d9ccd-4b72-4063-b89a-ae6a3466a743. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.network.neutron [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updating instance_info_cache with network_info: [{"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0a8eccf5-610b-478d-9cdf-6886b6a206a4 req-6f254686-8390-4cbe-90ad-27858f52e40e service nova] Releasing lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Creating config drive at /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.config
Nov 28 13:55:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq3y3467d {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq3y3467d" returned: 0 in 0.059s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Updating instance_info_cache with network_info: [{"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Releasing lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Instance network_info: |[{"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] Acquired lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.network.neutron [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Refreshing network info cache for port 1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Start _get_guest_xml network_info=[{"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:55:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1507271553',display_name='tempest-TestVolumeSwap-server-1507271553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1507271553',id=7,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWrRYCdiugZ/CtrXqVD7eb5gUF2aQeZcK+0n7VM+NPSH+J/LVpNX8a1nsI34ZJBupBnzclrmU9wWLa+aW6mmPWCfOw3jkfYnl2HBeR1euPFYe3X7kvXFSQTwgf/TwJkNA==',key_name='tempest-keypair-888199441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b65587be998440ed8f615dcb2f8f0d97',ramdisk_id='',reservation_id='r-7cwjsgwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2093360749',owner_user_name='tempest-TestVolumeSwap-2093360749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecf1fd2414db4fb9a5006cc8f5441745',uuid=66c010a7-3604-41c4-9599-d41172a28fe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Converting VIF {"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:64:75,bridge_name='br-int',has_traffic_filtering=True,id=1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e,network=Network(6ed64d27-5b2e-4ac9-be8f-4e65a223f220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4690b3-7d') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lazy-loading 'pci_devices' on Instance uuid 66c010a7-3604-41c4-9599-d41172a28fe2 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:55:50 user nova-compute[75453]:   <uuid>66c010a7-3604-41c4-9599-d41172a28fe2</uuid>
Nov 28 13:55:50 user nova-compute[75453]:   <name>instance-00000007</name>
Nov 28 13:55:50 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:55:50 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:55:50 user nova-compute[75453]:   <metadata>
Nov 28 13:55:50 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:55:50 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:55:50 user nova-compute[75453]:       <nova:name>tempest-TestVolumeSwap-server-1507271553</nova:name>
Nov 28 13:55:50 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:55:50</nova:creationTime>
Nov 28 13:55:50 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:55:50 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:55:50 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:55:50 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:55:50 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:55:50 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:55:50 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:55:50 user nova-compute[75453]:       <nova:owner>
Nov 28 13:55:50 user nova-compute[75453]:         <nova:user uuid="ecf1fd2414db4fb9a5006cc8f5441745">tempest-TestVolumeSwap-2093360749-project-member</nova:user>
Nov 28 13:55:50 user nova-compute[75453]:         <nova:project uuid="b65587be998440ed8f615dcb2f8f0d97">tempest-TestVolumeSwap-2093360749</nova:project>
Nov 28 13:55:50 user nova-compute[75453]:       </nova:owner>
Nov 28 13:55:50 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:55:50 user nova-compute[75453]:       <nova:ports>
Nov 28 13:55:50 user nova-compute[75453]:         <nova:port uuid="1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e">
Nov 28 13:55:50 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 13:55:50 user nova-compute[75453]:         </nova:port>
Nov 28 13:55:50 user nova-compute[75453]:       </nova:ports>
Nov 28 13:55:50 user nova-compute[75453]:     </nova:instance>
Nov 28 13:55:50 user nova-compute[75453]:   </metadata>
Nov 28 13:55:50 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:55:50 user nova-compute[75453]:     <system>
Nov 28 13:55:50 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:55:50 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:55:50 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:55:50 user nova-compute[75453]:       <entry name="serial">66c010a7-3604-41c4-9599-d41172a28fe2</entry>
Nov 28 13:55:50 user nova-compute[75453]:       <entry name="uuid">66c010a7-3604-41c4-9599-d41172a28fe2</entry>
Nov 28 13:55:50 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:55:50 user nova-compute[75453]:     </system>
Nov 28 13:55:50 user nova-compute[75453]:   </sysinfo>
Nov 28 13:55:50 user nova-compute[75453]:   <os>
Nov 28 13:55:50 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:55:50 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:55:50 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:55:50 user nova-compute[75453]:   </os>
Nov 28 13:55:50 user nova-compute[75453]:   <features>
Nov 28 13:55:50 user nova-compute[75453]:     <acpi/>
Nov 28 13:55:50 user nova-compute[75453]:     <apic/>
Nov 28 13:55:50 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:55:50 user nova-compute[75453]:   </features>
Nov 28 13:55:50 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:55:50 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:55:50 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:55:50 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:55:50 user nova-compute[75453]:   </clock>
Nov 28 13:55:50 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:55:50 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:55:50 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:55:50 user nova-compute[75453]:   </cpu>
Nov 28 13:55:50 user nova-compute[75453]:   <devices>
Nov 28 13:55:50 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:55:50 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:55:50 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk"/>
Nov 28 13:55:50 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:55:50 user nova-compute[75453]:     </disk>
Nov 28 13:55:50 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:55:50 user nova-compute[75453]:       <mac address="fa:16:3e:97:64:75"/>
Nov 28 13:55:50 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:50 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:55:50 user nova-compute[75453]:       <target dev="tap1f4690b3-7d"/>
Nov 28 13:55:50 user nova-compute[75453]:     </interface>
Nov 28 13:55:50 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:55:50 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/console.log" append="off"/>
Nov 28 13:55:50 user nova-compute[75453]:     </serial>
Nov 28 13:55:50 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:55:50 user nova-compute[75453]:     <video>
Nov 28 13:55:50 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:50 user nova-compute[75453]:     </video>
Nov 28 13:55:50 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:55:50 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:55:50 user nova-compute[75453]:     </rng>
Nov 28 13:55:50 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:55:50 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:55:50 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:55:50 user nova-compute[75453]:     </memballoon>
Nov 28 13:55:50 user nova-compute[75453]:   </devices>
Nov 28 13:55:50 user nova-compute[75453]: </domain>
Nov 28 13:55:50 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1507271553',display_name='tempest-TestVolumeSwap-server-1507271553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1507271553',id=7,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWrRYCdiugZ/CtrXqVD7eb5gUF2aQeZcK+0n7VM+NPSH+J/LVpNX8a1nsI34ZJBupBnzclrmU9wWLa+aW6mmPWCfOw3jkfYnl2HBeR1euPFYe3X7kvXFSQTwgf/TwJkNA==',key_name='tempest-keypair-888199441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b65587be998440ed8f615dcb2f8f0d97',ramdisk_id='',reservation_id='r-7cwjsgwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2093360749',owner_user_name='tempest-TestVolumeSwap-2093360749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecf1fd2414db4fb9a5006cc8f5441745',uuid=66c010a7-3604-41c4-9599-d41172a28fe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Converting VIF {"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:64:75,bridge_name='br-int',has_traffic_filtering=True,id=1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e,network=Network(6ed64d27-5b2e-4ac9-be8f-4e65a223f220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4690b3-7d') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG os_vif [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:64:75,bridge_name='br-int',has_traffic_filtering=True,id=1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e,network=Network(6ed64d27-5b2e-4ac9-be8f-4e65a223f220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4690b3-7d') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce8f710d-7d0d-50c7-bd01-9909395a7aeb', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f4690b3-7d, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f4690b3-7d, col_values=(('qos', UUID('90721f49-6660-4a9e-a198-9f914ad41ca9')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f4690b3-7d, col_values=(('external_ids', {'iface-id': '1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:64:75', 'vm-uuid': '66c010a7-3604-41c4-9599-d41172a28fe2'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:50 user nova-compute[75453]: INFO os_vif [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:64:75,bridge_name='br-int',has_traffic_filtering=True,id=1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e,network=Network(6ed64d27-5b2e-4ac9-be8f-4e65a223f220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4690b3-7d')
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:55:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] No VIF found with MAC fa:16:3e:97:64:75, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:55:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Updated VIF entry in instance network info cache for port 1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:55:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Updating instance_info_cache with network_info: [{"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cc820d17-eec4-4a77-a332-465d2659aeba req-f9eb218c-0121-4c46-8f88-20fe8efda477 service nova] Releasing lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-plugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] No waiting events found dispatching network-vif-plugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:53 user nova-compute[75453]: WARNING nova.compute.manager [req-957f9f06-0f82-4fae-8049-ab9ef054adcd req-e5032e86-f2b1-4e8e-98ab-d174e02a0136 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received unexpected event network-vif-plugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance with vm_state building and task_state spawning.
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:55:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:55:54 user nova-compute[75453]: INFO nova.compute.claims [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Claim successful on node user
Nov 28 13:55:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-plugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] No waiting events found dispatching network-vif-plugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:55 user nova-compute[75453]: WARNING nova.compute.manager [req-269d5c4e-3a10-420b-a0ce-96883fa2d965 req-3ef1031e-860a-4876-91ce-f8f2fd098673 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received unexpected event network-vif-plugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance with vm_state building and task_state spawning.
Nov 28 13:55:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.policy [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39fa3c5315ca4202bd2fdde394f2ccba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31479b67e7b34434a9498cb6b982d4f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:55:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Creating image(s)
Nov 28 13:55:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "/opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "/opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "/opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.268s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.248s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk 1073741824" returned: 0 in 0.062s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.277s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG nova.network.neutron [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Successfully created port: 0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Cannot resize image /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Ensure instance console log exists: /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Instance spawned successfully.
Nov 28 13:55:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:55:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Instance spawned successfully.
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received event network-vif-plugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] Acquiring lock "949a3612-5042-420f-9911-ec641017d399-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] Lock "949a3612-5042-420f-9911-ec641017d399-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] Lock "949a3612-5042-420f-9911-ec641017d399-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] No waiting events found dispatching network-vif-plugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:57 user nova-compute[75453]: WARNING nova.compute.manager [req-47e6b583-495b-4189-9b0c-1fd58985802c req-7417f201-62e3-4243-9daa-778e51632c95 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received unexpected event network-vif-plugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance with vm_state active and task_state None.
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:55:57 user nova-compute[75453]: INFO nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Took 10.79 seconds to spawn the instance on the hypervisor.
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:55:57 user nova-compute[75453]: INFO nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Took 11.85 seconds to spawn the instance on the hypervisor.
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:55:57 user nova-compute[75453]: INFO nova.compute.manager [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Took 12.01 seconds to build instance.
Nov 28 13:55:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c4e2472c-dbe3-4869-982a-b24c8b766ece tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.144s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:57 user nova-compute[75453]: INFO nova.compute.manager [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Took 12.88 seconds to build instance.
Nov 28 13:55:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1b21907d-cdbb-45a1-ab82-41b7f6755dff tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.154s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 13:55:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Successfully updated port: 0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "refresh_cache-57dc143b-7f7a-46e4-85c2-bed1c455b92d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquired lock "refresh_cache-57dc143b-7f7a-46e4-85c2-bed1c455b92d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received event network-changed-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Refreshing instance network info cache due to event network-changed-0b01647b-3ee6-4152-adac-c584772d441a. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] Acquiring lock "refresh_cache-57dc143b-7f7a-46e4-85c2-bed1c455b92d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Updating instance_info_cache with network_info: [{"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Releasing lock "refresh_cache-57dc143b-7f7a-46e4-85c2-bed1c455b92d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Instance network_info: |[{"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] Acquired lock "refresh_cache-57dc143b-7f7a-46e4-85c2-bed1c455b92d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:55:58 user nova-compute[75453]: DEBUG nova.network.neutron [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Refreshing network info cache for port 0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Start _get_guest_xml network_info=[{"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:55:59 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:59 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-775124193',display_name='tempest-VolumesAssistedSnapshotsTest-server-775124193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-775124193',id=8,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCI7gVF0ciHiIMVAJZbprWHL7zURwQNS0Z7LcSqMKBqZ4iid4/3E0j/cFAiCmqvQgRBJ7cRgNWmkMO5eTy2VY9d4WYAn8RfhPs9LVIcR+tbmQ11oSnDXM+sw9EFjRsdGw==',key_name='tempest-keypair-1355928653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31479b67e7b34434a9498cb6b982d4f7',ramdisk_id='',reservation_id='r-zoqvoulk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1977047969',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1977047969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39fa3c5315ca4202bd2fdde394f2ccba',uuid=57dc143b-7f7a-46e4-85c2-bed1c455b92d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Converting VIF {"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8f:02,bridge_name='br-int',has_traffic_filtering=True,id=0b01647b-3ee6-4152-adac-c584772d441a,network=Network(51f3b6a3-ef05-464a-a3df-dcd433b3e54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b01647b-3e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.objects.instance [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lazy-loading 'pci_devices' on Instance uuid 57dc143b-7f7a-46e4-85c2-bed1c455b92d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:55:59 user nova-compute[75453]:   <uuid>57dc143b-7f7a-46e4-85c2-bed1c455b92d</uuid>
Nov 28 13:55:59 user nova-compute[75453]:   <name>instance-00000008</name>
Nov 28 13:55:59 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:55:59 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:55:59 user nova-compute[75453]:   <metadata>
Nov 28 13:55:59 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:55:59 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:55:59 user nova-compute[75453]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-775124193</nova:name>
Nov 28 13:55:59 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:55:59</nova:creationTime>
Nov 28 13:55:59 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:55:59 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:55:59 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:55:59 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:55:59 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:55:59 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:55:59 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:55:59 user nova-compute[75453]:       <nova:owner>
Nov 28 13:55:59 user nova-compute[75453]:         <nova:user uuid="39fa3c5315ca4202bd2fdde394f2ccba">tempest-VolumesAssistedSnapshotsTest-1977047969-project-member</nova:user>
Nov 28 13:55:59 user nova-compute[75453]:         <nova:project uuid="31479b67e7b34434a9498cb6b982d4f7">tempest-VolumesAssistedSnapshotsTest-1977047969</nova:project>
Nov 28 13:55:59 user nova-compute[75453]:       </nova:owner>
Nov 28 13:55:59 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:55:59 user nova-compute[75453]:       <nova:ports>
Nov 28 13:55:59 user nova-compute[75453]:         <nova:port uuid="0b01647b-3ee6-4152-adac-c584772d441a">
Nov 28 13:55:59 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 13:55:59 user nova-compute[75453]:         </nova:port>
Nov 28 13:55:59 user nova-compute[75453]:       </nova:ports>
Nov 28 13:55:59 user nova-compute[75453]:     </nova:instance>
Nov 28 13:55:59 user nova-compute[75453]:   </metadata>
Nov 28 13:55:59 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:55:59 user nova-compute[75453]:     <system>
Nov 28 13:55:59 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:55:59 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:55:59 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:55:59 user nova-compute[75453]:       <entry name="serial">57dc143b-7f7a-46e4-85c2-bed1c455b92d</entry>
Nov 28 13:55:59 user nova-compute[75453]:       <entry name="uuid">57dc143b-7f7a-46e4-85c2-bed1c455b92d</entry>
Nov 28 13:55:59 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:55:59 user nova-compute[75453]:     </system>
Nov 28 13:55:59 user nova-compute[75453]:   </sysinfo>
Nov 28 13:55:59 user nova-compute[75453]:   <os>
Nov 28 13:55:59 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:55:59 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:55:59 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:55:59 user nova-compute[75453]:   </os>
Nov 28 13:55:59 user nova-compute[75453]:   <features>
Nov 28 13:55:59 user nova-compute[75453]:     <acpi/>
Nov 28 13:55:59 user nova-compute[75453]:     <apic/>
Nov 28 13:55:59 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:55:59 user nova-compute[75453]:   </features>
Nov 28 13:55:59 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:55:59 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:55:59 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:55:59 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:55:59 user nova-compute[75453]:   </clock>
Nov 28 13:55:59 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:55:59 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:55:59 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:55:59 user nova-compute[75453]:   </cpu>
Nov 28 13:55:59 user nova-compute[75453]:   <devices>
Nov 28 13:55:59 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:55:59 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:55:59 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk"/>
Nov 28 13:55:59 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:55:59 user nova-compute[75453]:     </disk>
Nov 28 13:55:59 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:55:59 user nova-compute[75453]:       <mac address="fa:16:3e:b1:8f:02"/>
Nov 28 13:55:59 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:59 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:55:59 user nova-compute[75453]:       <target dev="tap0b01647b-3e"/>
Nov 28 13:55:59 user nova-compute[75453]:     </interface>
Nov 28 13:55:59 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:55:59 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/console.log" append="off"/>
Nov 28 13:55:59 user nova-compute[75453]:     </serial>
Nov 28 13:55:59 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:55:59 user nova-compute[75453]:     <video>
Nov 28 13:55:59 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:55:59 user nova-compute[75453]:     </video>
Nov 28 13:55:59 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:55:59 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:55:59 user nova-compute[75453]:     </rng>
Nov 28 13:55:59 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:55:59 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:55:59 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:55:59 user nova-compute[75453]:     </memballoon>
Nov 28 13:55:59 user nova-compute[75453]:   </devices>
Nov 28 13:55:59 user nova-compute[75453]: </domain>
Nov 28 13:55:59 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-775124193',display_name='tempest-VolumesAssistedSnapshotsTest-server-775124193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-775124193',id=8,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCI7gVF0ciHiIMVAJZbprWHL7zURwQNS0Z7LcSqMKBqZ4iid4/3E0j/cFAiCmqvQgRBJ7cRgNWmkMO5eTy2VY9d4WYAn8RfhPs9LVIcR+tbmQ11oSnDXM+sw9EFjRsdGw==',key_name='tempest-keypair-1355928653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31479b67e7b34434a9498cb6b982d4f7',ramdisk_id='',reservation_id='r-zoqvoulk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1977047969',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1977047969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:55:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39fa3c5315ca4202bd2fdde394f2ccba',uuid=57dc143b-7f7a-46e4-85c2-bed1c455b92d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Converting VIF {"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8f:02,bridge_name='br-int',has_traffic_filtering=True,id=0b01647b-3ee6-4152-adac-c584772d441a,network=Network(51f3b6a3-ef05-464a-a3df-dcd433b3e54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b01647b-3e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG os_vif [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8f:02,bridge_name='br-int',has_traffic_filtering=True,id=0b01647b-3ee6-4152-adac-c584772d441a,network=Network(51f3b6a3-ef05-464a-a3df-dcd433b3e54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b01647b-3e') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8774d8b2-d3af-593a-b2bc-8f475c6b906e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b01647b-3e, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b01647b-3e, col_values=(('qos', UUID('a180346c-c85c-47c7-baf0-589e2164fe35')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b01647b-3e, col_values=(('external_ids', {'iface-id': '0b01647b-3ee6-4152-adac-c584772d441a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:8f:02', 'vm-uuid': '57dc143b-7f7a-46e4-85c2-bed1c455b92d'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:55:59 user nova-compute[75453]: INFO os_vif [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:8f:02,bridge_name='br-int',has_traffic_filtering=True,id=0b01647b-3ee6-4152-adac-c584772d441a,network=Network(51f3b6a3-ef05-464a-a3df-dcd433b3e54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b01647b-3e')
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received event network-vif-plugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Acquiring lock "949a3612-5042-420f-9911-ec641017d399-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Lock "949a3612-5042-420f-9911-ec641017d399-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Lock "949a3612-5042-420f-9911-ec641017d399-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] No waiting events found dispatching network-vif-plugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:59 user nova-compute[75453]: WARNING nova.compute.manager [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received unexpected event network-vif-plugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance with vm_state active and task_state None.
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] No waiting events found dispatching network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:59 user nova-compute[75453]: WARNING nova.compute.manager [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received unexpected event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e for instance with vm_state active and task_state None.
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] No waiting events found dispatching network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:55:59 user nova-compute[75453]: WARNING nova.compute.manager [req-c3485d2c-2641-426d-a5bb-e908bbe5301e req-e1da0aaf-58fa-4e30-b68f-0cc02fc3d6e8 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received unexpected event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e for instance with vm_state active and task_state None.
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] No VIF found with MAC fa:16:3e:b1:8f:02, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.network.neutron [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Updated VIF entry in instance network info cache for port 0b01647b-3ee6-4152-adac-c584772d441a. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.network.neutron [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Updating instance_info_cache with network_info: [{"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-84eb4ce0-7900-4188-87b7-b6556eff2cf5 req-45dc0b27-62f8-4c30-bb32-6e590d9c733c service nova] Releasing lock "refresh_cache-57dc143b-7f7a-46e4-85c2-bed1c455b92d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:55:59 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 13:56:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received event network-vif-plugged-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] No waiting events found dispatching network-vif-plugged-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:01 user nova-compute[75453]: WARNING nova.compute.manager [req-92d40e85-22aa-4d2f-8f62-f9fad1138708 req-6c184700-ad7f-462f-9e29-1d0f78dfeabf service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received unexpected event network-vif-plugged-0b01647b-3ee6-4152-adac-c584772d441a for instance with vm_state building and task_state spawning.
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:56:03 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Instance spawned successfully.
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:03 user nova-compute[75453]: INFO nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Took 7.60 seconds to spawn the instance on the hypervisor.
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:03 user nova-compute[75453]: INFO nova.compute.manager [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Took 8.93 seconds to build instance.
Nov 28 13:56:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-34c492ac-853d-4612-acf2-f2a1b4465b1e tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.093s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received event network-vif-plugged-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] No waiting events found dispatching network-vif-plugged-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:03 user nova-compute[75453]: WARNING nova.compute.manager [req-cc6c5635-0a09-4265-a68a-386870d3b284 req-736ba5aa-f6ca-4acd-9ae3-e2ea42298d25 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received unexpected event network-vif-plugged-0b01647b-3ee6-4152-adac-c584772d441a for instance with vm_state active and task_state None.
Nov 28 13:56:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received event network-vif-plugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] No waiting events found dispatching network-vif-plugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:04 user nova-compute[75453]: WARNING nova.compute.manager [req-58b5b856-c356-4210-9898-d1b0c31674a6 req-595c5a66-1efd-4f3b-bfb4-b0920ea2604b service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received unexpected event network-vif-plugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance with vm_state active and task_state None.
Nov 28 13:56:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received event network-vif-plugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] No waiting events found dispatching network-vif-plugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:06 user nova-compute[75453]: WARNING nova.compute.manager [req-11960a21-175b-4382-b2dc-226b623202fd req-06e988b3-833b-4fba-b332-6791a084ef77 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received unexpected event network-vif-plugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance with vm_state active and task_state None.
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:07 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:56:07 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:56:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7850MB free_disk=25.657047271728516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 13:56:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 48dd0221-4935-4ee2-9958-90a748fe5255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 949a3612-5042-420f-9911-ec641017d399 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance a9a21b61-5815-47ed-adac-040b1fc8e33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 66c010a7-3604-41c4-9599-d41172a28fe2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 13:56:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.060s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:56:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:56:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 13:56:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 13:56:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:09 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 13:56:09 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 48dd0221-4935-4ee2-9958-90a748fe5255 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:56:10 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Updating instance_info_cache with network_info: [{"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 13:56:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:56:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:56:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:56:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:56:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:56:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 13:56:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:56:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:13 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:56:13 user nova-compute[75453]: INFO nova.compute.claims [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Claim successful on node user
Nov 28 13:56:13 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:56:13 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:56:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:56:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:56:13 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:56:13 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:56:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:56:13 user nova-compute[75453]: INFO nova.virt.block_device [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Booting with volume 65c62840-e7a4-4bbb-861e-e4566ff910eb at /dev/vda
Nov 28 13:56:13 user nova-compute[75453]: DEBUG nova.policy [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72ed3093372d454e9f271d3d672ce8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac13581ec1439eb3208cc3ddbec53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:56:13 user nova-compute[75453]: DEBUG os_brick.utils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:13 user nova-compute[75453]: INFO oslo.privsep.daemon [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp7bpivb0q/privsep.sock']
Nov 28 13:56:13 user sudo[86543]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp7bpivb0q/privsep.sock
Nov 28 13:56:13 user sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 13:56:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:14 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully created port: 2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully created port: c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "794937d9-3c23-41cf-bb74-767e93bc1370" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:56:15 user sudo[86543]: pam_unix(sudo:session): session closed for user root
Nov 28 13:56:15 user nova-compute[75453]: INFO oslo.privsep.daemon [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Spawned new privsep daemon via rootwrap
Nov 28 13:56:15 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 13:56:15 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 13:56:15 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 28 13:56:15 user nova-compute[75453]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86546
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29328cc-52e6-4328-8924-eadab5091606]: (2,) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:56:15 user nova-compute[75453]: INFO nova.compute.claims [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Claim successful on node user
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[25845627-0482-4e25-a116-e66a3aa8244c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:15 user nova-compute[75453]: WARNING os_brick.initiator.connectors.nvmeof [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully created port: 03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e83a502-665e-4e47-a0fc-81a4a64d37f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cd1625-d9e1-42a5-8bfa-c2fca5ddd132]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[545e8e78-cbfb-4fde-8f3d-2bb5dc6d38fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:15 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:56:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d63cb1-887e-439f-a31f-886465231ddf]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.utils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] <== get_connector_properties: return (2069ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating existing volume attachment record: 5434a356-71c4-44f6-9ef1-3581941f2b87 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:56:16 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:56:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:56:16 user nova-compute[75453]: INFO nova.virt.block_device [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Booting with volume 46ef3fc0-9e51-4dec-bb48-5113d0dde6ab at /dev/vda
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.utils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[50249720-9490-4eec-a9f6-54f5365ad042]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaea73d-ce58-46d8-9801-b8feeac795a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cbf719-0d89-46e3-aa14-5de4e3a71195]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[595dc916-9e51-425a-adbe-68f9d3d475b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:16 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:56:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3955aaf7-0e08-41fe-866b-1f67519337c5]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG os_brick.utils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating existing volume attachment record: 7c34c3ea-96f3-4cca-a827-c27920af47a2 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:56:16 user nova-compute[75453]: DEBUG nova.policy [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a16ed449c2e749fcafc01dd97b83241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112860fded124331bc667a597f4c695d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:56:17 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully created port: cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully created port: 540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully created port: 10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully created port: edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully updated port: 2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-changed-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing instance network info cache due to event network-changed-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] Acquiring lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] Acquired lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:19 user nova-compute[75453]: DEBUG nova.network.neutron [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing network info cache for port 2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:19 user nova-compute[75453]: DEBUG nova.network.neutron [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:20 user nova-compute[75453]: DEBUG nova.network.neutron [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b65161b0-4540-472c-9772-065be269e916 req-059ba675-febe-43c9-a526-3d78baac4221 service nova] Releasing lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:20 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully created port: 9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:21 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully updated port: 96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-changed-96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing instance network info cache due to event network-changed-96485176-c454-4c24-bbe8-2cf688a69119. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] Acquiring lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] Acquired lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:21 user nova-compute[75453]: DEBUG nova.network.neutron [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing network info cache for port 96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:21 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully created port: a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:21 user nova-compute[75453]: DEBUG nova.network.neutron [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:22 user nova-compute[75453]: DEBUG nova.network.neutron [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dfd97f17-3714-4032-b349-8c5acf9ec383 req-30b06d19-5c7a-4f98-826b-22b10b7930bb service nova] Releasing lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully updated port: 5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully created port: 494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:23 user nova-compute[75453]: INFO nova.virt.block_device [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Booting with volume dd24adeb-40e1-4836-a51a-a0948ce76397 at /dev/vdb
Nov 28 13:56:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-changed-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing instance network info cache due to event network-changed-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] Acquiring lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] Acquired lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG nova.network.neutron [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing network info cache for port 5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG os_brick.utils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0555f28b-cda9-466e-a6f2-dc170efcc1d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[67455437-4524-4df1-bc57-c5eca5afed52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbffcdd-36af-4135-aeee-ccf966863e01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17e61cb-fb25-4cad-a190-17a1a2011e92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:23 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:56:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6456e80a-b7a4-446d-8041-bad0560770ad]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG os_brick.utils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating existing volume attachment record: 0c060ed5-e2d0-468e-a84b-5fcad9b0c2f8 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:56:23 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully updated port: c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:24 user nova-compute[75453]: DEBUG nova.network.neutron [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:24 user nova-compute[75453]: DEBUG nova.network.neutron [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3f342ede-074d-4ee4-92c2-aaa139ad5fd6 req-55c2f689-a384-4b7d-9b06-ce68b09ffcb5 service nova] Releasing lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:24 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully updated port: 540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully updated port: 03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully updated port: c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-changed-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing instance network info cache due to event network-changed-c34e615b-e133-4780-8a90-ca0fb5262dfe. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Acquiring lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Acquired lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:25 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing network info cache for port c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:25 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Releasing lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-changed-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing instance network info cache due to event network-changed-540a415e-6e64-4d9f-ba49-ec2a1a85439a. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Acquiring lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Acquired lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing network info cache for port 540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Releasing lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-changed-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing instance network info cache due to event network-changed-03fc3793-a8b8-456b-a80f-c9c5d6925c0b. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Acquiring lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Acquired lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing network info cache for port 03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully updated port: cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Releasing lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-changed-c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing instance network info cache due to event network-changed-c91797e6-0bbb-48ea-b5c2-278b0b4319ef. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Acquiring lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Acquired lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing network info cache for port c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully updated port: 605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-changed-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing instance network info cache due to event network-changed-cf289519-83a0-4374-b2e5-757e5e7248f1. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] Acquiring lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] Acquired lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing network info cache for port cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d6c07b7-d5c4-4ead-a7fd-29d66959abf4 req-f822d78d-306b-43dd-8a18-7689cbfe44eb service nova] Releasing lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-898ae1d5-3c32-4bd0-97be-e1e580b4d0b2 req-86594a2d-bc68-4007-961d-8abc76097587 service nova] Releasing lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Successfully updated port: 10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquired lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:56:29 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:29 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully updated port: edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-changed-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing instance network info cache due to event network-changed-605c90e8-31d1-4efa-b5c1-de9f7eeaec51. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Acquiring lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Acquired lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing network info cache for port 605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG nova.network.neutron [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG nova.network.neutron [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Releasing lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-changed-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing instance network info cache due to event network-changed-10cbc52f-989f-4a58-9fea-8ca5184c55d3. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Acquiring lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully updated port: 9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:30 user nova-compute[75453]: INFO nova.virt.block_device [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Booting with volume f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e at /dev/vdb
Nov 28 13:56:30 user nova-compute[75453]: DEBUG os_brick.utils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cac9eb5-4424-4e89-9a8a-01008b5f9c91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd63813-5357-469d-a537-80658ba2fbcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a69a3-caab-4d71-9686-89ad2dc51bcc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecb282f-1682-40f7-8826-8761918ef268]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:31 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[05246c4e-bac4-41fd-8f74-b7cfd49deefb]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG os_brick.utils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating existing volume attachment record: 1bf00234-2f00-466b-b70e-50f15b59e3bd {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:31 user nova-compute[75453]: INFO nova.virt.block_device [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Booting with volume a1359c5c-4f59-4469-a1bf-3edbe189d324 at /dev/vdc
Nov 28 13:56:31 user nova-compute[75453]: DEBUG os_brick.utils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f36f1e8-f915-4bd8-8e07-2e90e2c7e18a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ccbcc4-3cc2-4ae1-9f43-be0f6263f6b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f90ac0c-16e6-4647-8c6d-432da389dce1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b439fe9-6534-4742-b38b-2c0554bb94aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-changed-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing instance network info cache due to event network-changed-9daa350f-1a8b-41c9-8fd4-52e99d65b25f. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] Acquiring lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] Acquired lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing network info cache for port 9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:32 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:56:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6dc036-1ed2-41a0-876f-96a13c057884]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG os_brick.utils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating existing volume attachment record: 8b82ad2a-343d-47ba-8944-ee9015b3f19c {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully updated port: a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3dc121b3-8a27-40c1-8842-3c4ce26ab81b req-05f9f029-87b2-4bac-b23d-52fc03b5373c service nova] Releasing lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.network.neutron [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [{"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Releasing lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance network_info: |[{"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Acquired lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing network info cache for port 10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.network.neutron [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updated VIF entry in instance network info cache for port 10cbc52f-989f-4a58-9fea-8ca5184c55d3. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.network.neutron [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [{"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Releasing lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-changed-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing instance network info cache due to event network-changed-edf36fdd-4dd8-4465-8669-37b6adf82416. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Acquiring lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Acquired lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.network.neutron [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing network info cache for port edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Successfully updated port: 494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.network.neutron [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.network.neutron [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aeb642d6-c844-470b-8f1f-ddad03e4ca78 req-c7145fd6-8d52-4d20-8811-9e5fd638cd8a service nova] Releasing lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquired lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:56:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-changed-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing instance network info cache due to event network-changed-a6e94133-9c6d-4d82-a2fe-56e7b65450bb. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Acquiring lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:35 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [{"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Releasing lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:35 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance network_info: |[{"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:56:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Acquired lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing network info cache for port a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:36 user nova-compute[75453]: DEBUG nova.network.neutron [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updated VIF entry in instance network info cache for port a6e94133-9c6d-4d82-a2fe-56e7b65450bb. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:56:36 user nova-compute[75453]: DEBUG nova.network.neutron [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [{"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Releasing lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-changed-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing instance network info cache due to event network-changed-494d17d8-bf46-4767-852b-4e578ef43377. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Acquiring lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Acquired lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:36 user nova-compute[75453]: DEBUG nova.network.neutron [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing network info cache for port 494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:37 user nova-compute[75453]: DEBUG nova.network.neutron [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updated VIF entry in instance network info cache for port 494d17d8-bf46-4767-852b-4e578ef43377. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:56:37 user nova-compute[75453]: DEBUG nova.network.neutron [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [{"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-29978036-2046-4f74-ba96-e918b749cd25 req-15e2a376-7334-40b3-a6db-822bdeb30f28 service nova] Releasing lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:56:39 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Creating image(s)
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Ensure instance console log exists: /opt/stack/data/nova/instances/31d8d6df-6235-4a05-a03b-b6d67c3698b2/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Start _get_guest_xml network_info=[{"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5434a356-71c4-44f6-9ef1-3581941f2b87', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zavUurtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31d8d6df-6235-4a05-a03b-b6d67c3698b2', 'attached_at': '', 'detached_at': '', 'volume_id': '65c62840-e7a4-4bbb-861e-e4566ff910eb', 'serial': '65c62840-e7a4-4bbb-861e-e4566ff910eb'}, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '0c060ed5-e2d0-468e-a84b-5fcad9b0c2f8', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHXpwlZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31d8d6df-6235-4a05-a03b-b6d67c3698b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd24adeb-40e1-4836-a51a-a0948ce76397', 'serial': 'dd24adeb-40e1-4836-a51a-a0948ce76397'}, 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '8b82ad2a-343d-47ba-8944-ee9015b3f19c', 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVuvmRPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31d8d6df-6235-4a05-a03b-b6d67c3698b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1359c5c-4f59-4469-a1bf-3edbe189d324', 'serial': 'a1359c5c-4f59-4469-a1bf-3edbe189d324'}, 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:56:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:56:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connector [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Factory for ISCSI on None {{(pid=75453) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zavUurtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:39 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:39 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:39 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51caba1-b2b5-4143-bd5e-3fabdce48d91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:56:39 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c40b2b-1d13-4fa9-9610-4b8f5f966ea5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb] added
Nov 28 13:56:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[22455bb4-dd5d-4375-829d-e8834132b5fa]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fafc2d-297b-479b-9467-58a86febc265]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zavUurtI {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zavUurtI" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8fdabb-ed88-4b37-af3a-623b453aecac]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zavUurtI'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a723e26-906b-4241-83a5-877d92c7876a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c02c41b-b4bd-4a69-a6ee-9d606c08b1f9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 13:56:39 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 13:56:39 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:39 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 13:56:39 user nova-compute[75453]: 
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5036b69-6131-4d5a-b952-5b96d6966d2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb, portal: 172.16.0.220,3260]
Nov 28 13:56:39 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb, portal: 172.16.0.220,3260] successful.
Nov 28 13:56:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6426c67-db6d-4677-a16d-90e3a1dc703a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af14905-8af0-4eae-be8f-aa683e76b669]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbec41f-cede-4454-9ced-05f94e0867f9]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zavUurtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23732363331393666', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732363331393666', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHXpwlZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:40 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:40 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:40 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ab7ec0-f6ae-4f0c-bf65-33d399226683]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:56:40 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ed9048-d9b3-4b75-8732-a47bbb28a544]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397] added
Nov 28 13:56:40 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a2641-4bb5-492b-8a4a-b7119f6e5161]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf3a2a5-c56c-4697-8a53-97419b6b1291]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHXpwlZD {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHXpwlZD" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[70687b94-f52f-4aca-aa50-cc1c0a5b614c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NHXpwlZD'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba94896-d73f-4192-9ef5-a1d396675dc3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[254ec313-3cba-4a67-872d-442aa1976bce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:41 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:41 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e853b8d-d8eb-4607-b072-0a1f7e6fc0ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397, portal: 172.16.0.220,3260]
Nov 28 13:56:41 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397, portal: 172.16.0.220,3260] successful.
Nov 28 13:56:41 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e069fc-de77-4dac-99ad-aebcd135accc]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c415892-a87b-41ae-b66d-a6767ae861a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:41 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:41 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:41 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:41 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[428b4ed5-c9ba-4235-a605-93061d29c420]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:56:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHXpwlZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26530366234623836', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530366234623836', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVuvmRPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:42 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:42 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:42 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdcc11c-5e19-4846-b8d8-aed453c12022]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:56:42 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb25f2a-6396-4675-b2f4-ac07e260f38d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324] added
Nov 28 13:56:42 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[74624c98-7b67-48f6-b8dd-95f051178b11]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1fde39-22e2-4182-be4b-0102847e59de]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVuvmRPD {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVuvmRPD" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[036ce386-76ae-43ea-b4d5-2b81d6b1ec6a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sVuvmRPD'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b046fc-519c-4d6b-bd1d-53ed11f07cc6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebb5280-45ff-44ba-b6f6-3026944405aa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:42 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:42 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:42 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:42 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c87298-61c0-4a1d-bcff-74453670c21d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324, portal: 172.16.0.220,3260]
Nov 28 13:56:42 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324, portal: 172.16.0.220,3260] successful.
Nov 28 13:56:42 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e31373-0ec2-4660-bd87-b77610aa1a8e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d763b6-22fa-4856-a8f8-b67eabe99a92]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:42 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:42 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:42 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:42 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:42 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:42 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f985db-2dd3-4c97-9a3c-75c9203b235c]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:56:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVuvmRPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23463346161363639', 'path': '/dev/sdd'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463346161363639', 'path': '/dev/sdd'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ec:37,bridge_name='br-int',has_traffic_filtering=True,id=2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8,network=Network(bbcbef15-20ec-4dd4-adb4-47914fd7aba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2348a0-f2') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:9d,bridge_name='br-int',has_traffic_filtering=True,id=96485176-c454-4c24-bbe8-2cf688a69119,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96485176-c4') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5872e8ad-8a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:1e:c6,bridge_name='br-int',has_traffic_filtering=True,id=c34e615b-e133-4780-8a90-ca0fb5262dfe,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34e615b-e1') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e2:df,bridge_name='br-int',has_traffic_filtering=True,id=03fc3793-a8b8-456b-a80f-c9c5d6925c0b,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fc3793-a8') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=cf289519-83a0-4374-b2e5-757e5e7248f1,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf289519-83') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=10cbc52f-989f-4a58-9fea-8ca5184c55d3,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cbc52f-98') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.objects.instance [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lazy-loading 'pci_devices' on Instance uuid 31d8d6df-6235-4a05-a03b-b6d67c3698b2 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:56:43 user nova-compute[75453]:   <uuid>31d8d6df-6235-4a05-a03b-b6d67c3698b2</uuid>
Nov 28 13:56:43 user nova-compute[75453]:   <name>instance-00000009</name>
Nov 28 13:56:43 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:56:43 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:56:43 user nova-compute[75453]:   <metadata>
Nov 28 13:56:43 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:56:43 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:56:43 user nova-compute[75453]:       <nova:name>tempest-device-tagging-server-593415065</nova:name>
Nov 28 13:56:43 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:56:39</nova:creationTime>
Nov 28 13:56:43 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:56:43 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:56:43 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:56:43 user nova-compute[75453]:       <nova:owner>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:user uuid="72ed3093372d454e9f271d3d672ce8a2">tempest-TaggedBootDevicesTest-461431762-project-member</nova:user>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:project uuid="c0ac13581ec1439eb3208cc3ddbec53a">tempest-TaggedBootDevicesTest-461431762</nova:project>
Nov 28 13:56:43 user nova-compute[75453]:       </nova:owner>
Nov 28 13:56:43 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:56:43 user nova-compute[75453]:       <nova:ports>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:port uuid="2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8">
Nov 28 13:56:43 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 13:56:43 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:port uuid="96485176-c454-4c24-bbe8-2cf688a69119">
Nov 28 13:56:43 user nova-compute[75453]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Nov 28 13:56:43 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:port uuid="5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1">
Nov 28 13:56:43 user nova-compute[75453]:           <nova:ip type="fixed" address="10.1.1.176" ipVersion="4"/>
Nov 28 13:56:43 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:port uuid="c34e615b-e133-4780-8a90-ca0fb5262dfe">
Nov 28 13:56:43 user nova-compute[75453]:           <nova:ip type="fixed" address="10.1.1.99" ipVersion="4"/>
Nov 28 13:56:43 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:port uuid="03fc3793-a8b8-456b-a80f-c9c5d6925c0b">
Nov 28 13:56:43 user nova-compute[75453]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Nov 28 13:56:43 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:port uuid="cf289519-83a0-4374-b2e5-757e5e7248f1">
Nov 28 13:56:43 user nova-compute[75453]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 13:56:43 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:43 user nova-compute[75453]:         <nova:port uuid="10cbc52f-989f-4a58-9fea-8ca5184c55d3">
Nov 28 13:56:43 user nova-compute[75453]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 13:56:43 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:43 user nova-compute[75453]:       </nova:ports>
Nov 28 13:56:43 user nova-compute[75453]:     </nova:instance>
Nov 28 13:56:43 user nova-compute[75453]:   </metadata>
Nov 28 13:56:43 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:56:43 user nova-compute[75453]:     <system>
Nov 28 13:56:43 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:56:43 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:56:43 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:56:43 user nova-compute[75453]:       <entry name="serial">31d8d6df-6235-4a05-a03b-b6d67c3698b2</entry>
Nov 28 13:56:43 user nova-compute[75453]:       <entry name="uuid">31d8d6df-6235-4a05-a03b-b6d67c3698b2</entry>
Nov 28 13:56:43 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:56:43 user nova-compute[75453]:     </system>
Nov 28 13:56:43 user nova-compute[75453]:   </sysinfo>
Nov 28 13:56:43 user nova-compute[75453]:   <os>
Nov 28 13:56:43 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:56:43 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:56:43 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:56:43 user nova-compute[75453]:   </os>
Nov 28 13:56:43 user nova-compute[75453]:   <features>
Nov 28 13:56:43 user nova-compute[75453]:     <acpi/>
Nov 28 13:56:43 user nova-compute[75453]:     <apic/>
Nov 28 13:56:43 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:56:43 user nova-compute[75453]:   </features>
Nov 28 13:56:43 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:56:43 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:56:43 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:56:43 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:56:43 user nova-compute[75453]:   </clock>
Nov 28 13:56:43 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:56:43 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:56:43 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:56:43 user nova-compute[75453]:   </cpu>
Nov 28 13:56:43 user nova-compute[75453]:   <devices>
Nov 28 13:56:43 user nova-compute[75453]:     <disk type="file" device="cdrom">
Nov 28 13:56:43 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 13:56:43 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/31d8d6df-6235-4a05-a03b-b6d67c3698b2/disk.config"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="hda" bus="ide"/>
Nov 28 13:56:43 user nova-compute[75453]:     </disk>
Nov 28 13:56:43 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 13:56:43 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:56:43 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <serial>65c62840-e7a4-4bbb-861e-e4566ff910eb</serial>
Nov 28 13:56:43 user nova-compute[75453]:     </disk>
Nov 28 13:56:43 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 13:56:43 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:56:43 user nova-compute[75453]:       <source dev="/dev/sdc"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <serial>dd24adeb-40e1-4836-a51a-a0948ce76397</serial>
Nov 28 13:56:43 user nova-compute[75453]:     </disk>
Nov 28 13:56:43 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 13:56:43 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:56:43 user nova-compute[75453]:       <source dev="/dev/sdd"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="vdc" bus="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <serial>a1359c5c-4f59-4469-a1bf-3edbe189d324</serial>
Nov 28 13:56:43 user nova-compute[75453]:     </disk>
Nov 28 13:56:43 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:43 user nova-compute[75453]:       <mac address="fa:16:3e:03:ec:37"/>
Nov 28 13:56:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="tap2d2348a0-f2"/>
Nov 28 13:56:43 user nova-compute[75453]:     </interface>
Nov 28 13:56:43 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:43 user nova-compute[75453]:       <mac address="fa:16:3e:2c:22:9d"/>
Nov 28 13:56:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="tap96485176-c4"/>
Nov 28 13:56:43 user nova-compute[75453]:     </interface>
Nov 28 13:56:43 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:43 user nova-compute[75453]:       <mac address="fa:16:3e:b6:40:1e"/>
Nov 28 13:56:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="tap5872e8ad-8a"/>
Nov 28 13:56:43 user nova-compute[75453]:     </interface>
Nov 28 13:56:43 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:43 user nova-compute[75453]:       <mac address="fa:16:3e:73:1e:c6"/>
Nov 28 13:56:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="tapc34e615b-e1"/>
Nov 28 13:56:43 user nova-compute[75453]:     </interface>
Nov 28 13:56:43 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:43 user nova-compute[75453]:       <mac address="fa:16:3e:d1:e2:df"/>
Nov 28 13:56:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="tap03fc3793-a8"/>
Nov 28 13:56:43 user nova-compute[75453]:     </interface>
Nov 28 13:56:43 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:43 user nova-compute[75453]:       <mac address="fa:16:3e:a6:45:3d"/>
Nov 28 13:56:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="tapcf289519-83"/>
Nov 28 13:56:43 user nova-compute[75453]:     </interface>
Nov 28 13:56:43 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:43 user nova-compute[75453]:       <mac address="fa:16:3e:69:c0:66"/>
Nov 28 13:56:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:43 user nova-compute[75453]:       <target dev="tap10cbc52f-98"/>
Nov 28 13:56:43 user nova-compute[75453]:     </interface>
Nov 28 13:56:43 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:56:43 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/31d8d6df-6235-4a05-a03b-b6d67c3698b2/console.log" append="off"/>
Nov 28 13:56:43 user nova-compute[75453]:     </serial>
Nov 28 13:56:43 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:56:43 user nova-compute[75453]:     <video>
Nov 28 13:56:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:43 user nova-compute[75453]:     </video>
Nov 28 13:56:43 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:56:43 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:56:43 user nova-compute[75453]:     </rng>
Nov 28 13:56:43 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:56:43 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:56:43 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:56:43 user nova-compute[75453]:     </memballoon>
Nov 28 13:56:43 user nova-compute[75453]:   </devices>
Nov 28 13:56:43 user nova-compute[75453]: </domain>
Nov 28 13:56:43 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ec:37,bridge_name='br-int',has_traffic_filtering=True,id=2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8,network=Network(bbcbef15-20ec-4dd4-adb4-47914fd7aba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2348a0-f2') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ec:37,bridge_name='br-int',has_traffic_filtering=True,id=2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8,network=Network(bbcbef15-20ec-4dd4-adb4-47914fd7aba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2348a0-f2') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2706555e-2a16-564f-93df-7d4732e3aa44', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d2348a0-f2, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d2348a0-f2, col_values=(('qos', UUID('86cdc619-c099-4870-8f24-97784170f0e6')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d2348a0-f2, col_values=(('external_ids', {'iface-id': '2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:ec:37', 'vm-uuid': '31d8d6df-6235-4a05-a03b-b6d67c3698b2'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: INFO os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ec:37,bridge_name='br-int',has_traffic_filtering=True,id=2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8,network=Network(bbcbef15-20ec-4dd4-adb4-47914fd7aba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2348a0-f2')
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:9d,bridge_name='br-int',has_traffic_filtering=True,id=96485176-c454-4c24-bbe8-2cf688a69119,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96485176-c4') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:9d,bridge_name='br-int',has_traffic_filtering=True,id=96485176-c454-4c24-bbe8-2cf688a69119,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96485176-c4') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '646b4f5b-0a59-5c16-a6bc-0ef8fe1d567e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96485176-c4, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96485176-c4, col_values=(('qos', UUID('fd28af06-64ba-4ea9-864e-7f12848f70b0')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96485176-c4, col_values=(('external_ids', {'iface-id': '96485176-c454-4c24-bbe8-2cf688a69119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:22:9d', 'vm-uuid': '31d8d6df-6235-4a05-a03b-b6d67c3698b2'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: INFO os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:9d,bridge_name='br-int',has_traffic_filtering=True,id=96485176-c454-4c24-bbe8-2cf688a69119,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96485176-c4')
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5872e8ad-8a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5872e8ad-8a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '197660a0-5823-548c-8dee-d56eabd08a2f', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5872e8ad-8a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5872e8ad-8a, col_values=(('qos', UUID('89ef72c9-8d77-4b4e-bdbe-f63de0c95484')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5872e8ad-8a, col_values=(('external_ids', {'iface-id': '5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:40:1e', 'vm-uuid': '31d8d6df-6235-4a05-a03b-b6d67c3698b2'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: INFO os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5872e8ad-8a')
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:1e:c6,bridge_name='br-int',has_traffic_filtering=True,id=c34e615b-e133-4780-8a90-ca0fb5262dfe,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34e615b-e1') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:1e:c6,bridge_name='br-int',has_traffic_filtering=True,id=c34e615b-e133-4780-8a90-ca0fb5262dfe,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34e615b-e1') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28f2a923-fcc5-5811-85a5-6797ae61d3b2', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc34e615b-e1, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc34e615b-e1, col_values=(('qos', UUID('b0997b49-ea28-44dc-91be-f7c075170648')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc34e615b-e1, col_values=(('external_ids', {'iface-id': 'c34e615b-e133-4780-8a90-ca0fb5262dfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:1e:c6', 'vm-uuid': '31d8d6df-6235-4a05-a03b-b6d67c3698b2'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: INFO os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:1e:c6,bridge_name='br-int',has_traffic_filtering=True,id=c34e615b-e133-4780-8a90-ca0fb5262dfe,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34e615b-e1')
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e2:df,bridge_name='br-int',has_traffic_filtering=True,id=03fc3793-a8b8-456b-a80f-c9c5d6925c0b,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fc3793-a8') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e2:df,bridge_name='br-int',has_traffic_filtering=True,id=03fc3793-a8b8-456b-a80f-c9c5d6925c0b,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fc3793-a8') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c102c5f9-174a-5ae1-ba49-c7c52bc7a9ec', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03fc3793-a8, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03fc3793-a8, col_values=(('qos', UUID('f63d5348-7485-470a-9887-59b440f442e4')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03fc3793-a8, col_values=(('external_ids', {'iface-id': '03fc3793-a8b8-456b-a80f-c9c5d6925c0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:e2:df', 'vm-uuid': '31d8d6df-6235-4a05-a03b-b6d67c3698b2'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: INFO os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e2:df,bridge_name='br-int',has_traffic_filtering=True,id=03fc3793-a8b8-456b-a80f-c9c5d6925c0b,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fc3793-a8')
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=cf289519-83a0-4374-b2e5-757e5e7248f1,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf289519-83') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=cf289519-83a0-4374-b2e5-757e5e7248f1,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf289519-83') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2bd4509-76d2-569d-ad7b-996643221299', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf289519-83, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf289519-83, col_values=(('qos', UUID('479fb2d7-1da5-4d85-8594-573c3ad90f86')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf289519-83, col_values=(('external_ids', {'iface-id': 'cf289519-83a0-4374-b2e5-757e5e7248f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:45:3d', 'vm-uuid': '31d8d6df-6235-4a05-a03b-b6d67c3698b2'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: INFO os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=cf289519-83a0-4374-b2e5-757e5e7248f1,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf289519-83')
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=10cbc52f-989f-4a58-9fea-8ca5184c55d3,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cbc52f-98') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=10cbc52f-989f-4a58-9fea-8ca5184c55d3,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cbc52f-98') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5a268e2-76bc-5105-aaad-18556fb49433', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10cbc52f-98, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10cbc52f-98, col_values=(('qos', UUID('e68d2461-87bc-422a-b864-4eb527c1194e')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10cbc52f-98, col_values=(('external_ids', {'iface-id': '10cbc52f-989f-4a58-9fea-8ca5184c55d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:c0:66', 'vm-uuid': '31d8d6df-6235-4a05-a03b-b6d67c3698b2'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:44 user nova-compute[75453]: INFO os_vif [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=10cbc52f-989f-4a58-9fea-8ca5184c55d3,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cbc52f-98')
Nov 28 13:56:44 user nova-compute[75453]: INFO nova.virt.block_device [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Booting with volume c4143e1d-5911-4ff6-a035-e7c81788faa1 at /dev/vdc
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] No BDM found with device name hda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] No VIF found with MAC fa:16:3e:03:ec:37, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] No VIF found with MAC fa:16:3e:d1:e2:df, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:56:44 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Using config drive
Nov 28 13:56:44 user nova-compute[75453]: DEBUG os_brick.utils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2d4d78-44ce-4856-9745-ed8e573d5ada]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd02f52c-46e9-463f-b2ef-43f839baf9b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6fef39-5c05-4a92-8c16-f06a74ff5c70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee7f687-52ac-4ca7-94e8-87cadf2ac3d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:56:44 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[52431fed-8171-4703-b7f5-d6be47b4caa2]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG os_brick.utils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating existing volume attachment record: 284dbf12-484a-4962-9c85-eeb91e32d433 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:56:44 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Creating config drive at /opt/stack/data/nova/instances/31d8d6df-6235-4a05-a03b-b6d67c3698b2/disk.config
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/31d8d6df-6235-4a05-a03b-b6d67c3698b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbyrxoj4d {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/31d8d6df-6235-4a05-a03b-b6d67c3698b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbyrxoj4d" returned: 0 in 0.055s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:46 user nova-compute[75453]: WARNING nova.compute.manager [req-2c257cb4-ff0b-4381-8e60-bdfbbee23f35 req-dcbeecfb-4e7b-4901-b5e7-e1c13364c12c service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance with vm_state building and task_state spawning.
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:47 user nova-compute[75453]: WARNING nova.compute.manager [req-eef0698b-058d-4ee7-9e21-c1eec7765616 req-0e7431e1-7feb-4457-8d81-beae56d372bf service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance with vm_state building and task_state spawning.
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:48 user nova-compute[75453]: WARNING nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance with vm_state building and task_state spawning.
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:48 user nova-compute[75453]: WARNING nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-96485176-c454-4c24-bbe8-2cf688a69119 for instance with vm_state building and task_state spawning.
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:48 user nova-compute[75453]: WARNING nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-96485176-c454-4c24-bbe8-2cf688a69119 for instance with vm_state building and task_state spawning.
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:48 user nova-compute[75453]: WARNING nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 for instance with vm_state building and task_state spawning.
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:48 user nova-compute[75453]: WARNING nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 for instance with vm_state building and task_state spawning.
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:48 user nova-compute[75453]: WARNING nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-c34e615b-e133-4780-8a90-ca0fb5262dfe for instance with vm_state building and task_state spawning.
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:48 user nova-compute[75453]: WARNING nova.compute.manager [req-2b112471-e1c6-4e34-bc6b-e58a6826642a req-748ea503-22e1-452c-86be-c93689656c1a service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-c34e615b-e133-4780-8a90-ca0fb5262dfe for instance with vm_state building and task_state spawning.
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:50 user nova-compute[75453]: WARNING nova.compute.manager [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance with vm_state building and task_state spawning.
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:50 user nova-compute[75453]: WARNING nova.compute.manager [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-cf289519-83a0-4374-b2e5-757e5e7248f1 for instance with vm_state building and task_state spawning.
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:50 user nova-compute[75453]: WARNING nova.compute.manager [req-c0da61c8-5052-454b-8d4f-1b6f638a0da9 req-a3717dd1-6ade-4621-a0b0-38e3373436ef service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-cf289519-83a0-4374-b2e5-757e5e7248f1 for instance with vm_state building and task_state spawning.
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:56:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance spawned successfully.
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:50 user nova-compute[75453]: WARNING nova.compute.manager [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance with vm_state building and task_state spawning.
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:50 user nova-compute[75453]: WARNING nova.compute.manager [req-ef690344-feb3-444e-acba-e317c6e5c96f req-5406d275-adf4-4cf5-88eb-d5c454a74e2e service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance with vm_state building and task_state spawning.
Nov 28 13:56:50 user nova-compute[75453]: INFO nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Took 11.38 seconds to spawn the instance on the hypervisor.
Nov 28 13:56:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:56:50 user nova-compute[75453]: INFO nova.compute.manager [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Took 38.02 seconds to build instance.
Nov 28 13:56:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-52b559fd-c21d-4fa1-b37b-45c29ee9b271 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.138s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:56:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Creating image(s)
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Ensure instance console log exists: /opt/stack/data/nova/instances/794937d9-3c23-41cf-bb74-767e93bc1370/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Start _get_guest_xml network_info=[{"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7c34c3ea-96f3-4cca-a827-c27920af47a2', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmdlMhzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '794937d9-3c23-41cf-bb74-767e93bc1370', 'attached_at': '', 'detached_at': '', 'volume_id': '46ef3fc0-9e51-4dec-bb48-5113d0dde6ab', 'serial': '46ef3fc0-9e51-4dec-bb48-5113d0dde6ab'}, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '1bf00234-2f00-466b-b70e-50f15b59e3bd', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnVwSJHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '794937d9-3c23-41cf-bb74-767e93bc1370', 'attached_at': '', 'detached_at': '', 'volume_id': 'f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e', 'serial': 'f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e'}, 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '284dbf12-484a-4962-9c85-eeb91e32d433', 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYhdaNnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '794937d9-3c23-41cf-bb74-767e93bc1370', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4143e1d-5911-4ff6-a035-e7c81788faa1', 'serial': 'c4143e1d-5911-4ff6-a035-e7c81788faa1'}, 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:56:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:56:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmdlMhzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:53 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:53 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:53 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c88e926-12b8-43d7-831b-58499e362aec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:56:53 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4386d44d-1019-40bb-a29a-d8c92066a9b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab] added
Nov 28 13:56:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f071bf86-1057-4f03-82c6-97230dc46aff]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c93aa6-bd3b-4419-a663-339c5f079ea1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmdlMhzw {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmdlMhzw" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a8956-0a84-44f2-be8f-291ba366e27d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmdlMhzw'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd8b13-d6ef-40e1-b2b0-77c32c3ce5cc]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1141cd-d25b-4a17-ac33-a2419b01671b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da09018-80e0-443e-9704-73db8935d82c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab, portal: 172.16.0.220,3260]
Nov 28 13:56:53 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab, portal: 172.16.0.220,3260] successful.
Nov 28 13:56:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0c618-b345-45e6-bc4d-ac09da5d08a9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[16956702-dd59-4363-ac7e-9187bccccbf3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:53 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8014bb56-9f1c-43cc-bc7f-32dfca04de2d]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmdlMhzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:56:53 user nova-compute[75453]: INFO nova.compute.claims [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Claim successful on node user
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:56:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.policy [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '570ac6978fc249ba93d39e40d5d7eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4bdacb213b463cb88e3d046e931b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:56:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Creating image(s)
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "/opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "/opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "/opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26164613661643231', 'path': '/dev/sde'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164613661643231', 'path': '/dev/sde'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnVwSJHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:54 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:54 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:54 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e181cfaf-2542-4d31-b2c9-a993669f5333]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:56:54 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1997abc3-8e49-404a-b541-3f53317cb97c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e] added
Nov 28 13:56:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b71d8-0aae-4b27-89ac-8dfb3be783e6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec81e1-5bfd-40b0-ba77-7d0478c03c63]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnVwSJHx {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnVwSJHx" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b094430-9af0-452d-865f-059e82a0a344]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hnVwSJHx'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6258514d-26c9-4e0c-89e4-6a76f71448c5]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab36f9d-e90f-46b5-8903-f6ab77dc198e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:54 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:54 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:54 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:54 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:54 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:54 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13c6f6a-dae3-494c-802c-4648cd1a0a6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e, portal: 172.16.0.220,3260]
Nov 28 13:56:54 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e, portal: 172.16.0.220,3260] successful.
Nov 28 13:56:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5331cd3c-9178-4895-a6d3-a4b2334d3048]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk 1073741824" returned: 0 in 0.047s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaf794a-423b-487a-b0ea-8d1d966d9a51]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:55 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:55 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:55 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:55 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:56:55 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:55 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:55 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:55 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:55 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:56:55 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfccceb0-e549-418e-af78-f98878de705b]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnVwSJHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Successfully created port: 1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.229s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Cannot resize image /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Ensure instance console log exists: /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Successfully updated port: 1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "refresh_cache-21bca975-80ab-4d17-8a2d-9435c5f9646f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquired lock "refresh_cache-21bca975-80ab-4d17-8a2d-9435c5f9646f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received event network-changed-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Refreshing instance network info cache due to event network-changed-1543b940-0c84-4e66-b424-f3c6fbd8c737. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] Acquiring lock "refresh_cache-21bca975-80ab-4d17-8a2d-9435c5f9646f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:56:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26532373566303465', 'path': '/dev/sdf'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532373566303465', 'path': '/dev/sdf'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYhdaNnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:56:56 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:56 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:56:56 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Updating instance_info_cache with network_info: [{"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb7905f-67ef-40ad-bcd8-69e410a8b38a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:56:56 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Releasing lock "refresh_cache-21bca975-80ab-4d17-8a2d-9435c5f9646f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Instance network_info: |[{"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] Acquired lock "refresh_cache-21bca975-80ab-4d17-8a2d-9435c5f9646f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.network.neutron [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Refreshing network info cache for port 1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Start _get_guest_xml network_info=[{"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5d1765-24af-4f9e-9e16-7696ee6a9418]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1] added
Nov 28 13:56:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:56:56 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d14b27-3633-4ee3-9fe1-bfa0b85cb280]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1509611543',display_name='tempest-VolumesSnapshotTestJSON-instance-1509611543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1509611543',id=11,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEZcduiQ4Bg+SyAMn1YHq4xZH858Iy0RGGFa+eLBzBoZOCJYpecnguM8KrxCXYdoPpgbGSlntpvAvtlnQy48NNkpQqMwqeZODnZhOhQ9HS/mZfIvCp+Xx38biZYtIPHOA==',key_name='tempest-keypair-1571158505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff4bdacb213b463cb88e3d046e931b9d',ramdisk_id='',reservation_id='r-q6pciizc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-766520769',owner_user_name='tempest-VolumesSnapshotTestJSON-766520769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='570ac6978fc249ba93d39e40d5d7eac7',uuid=21bca975-80ab-4d17-8a2d-9435c5f9646f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converting VIF {"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=1543b940-0c84-4e66-b424-f3c6fbd8c737,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1543b940-0c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.objects.instance [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'pci_devices' on Instance uuid 21bca975-80ab-4d17-8a2d-9435c5f9646f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a2005-6b73-4608-9834-ed8fa42101ff]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:56:56 user nova-compute[75453]:   <uuid>21bca975-80ab-4d17-8a2d-9435c5f9646f</uuid>
Nov 28 13:56:56 user nova-compute[75453]:   <name>instance-0000000b</name>
Nov 28 13:56:56 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:56:56 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:56:56 user nova-compute[75453]:   <metadata>
Nov 28 13:56:56 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:56:56 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:56:56 user nova-compute[75453]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1509611543</nova:name>
Nov 28 13:56:56 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:56:56</nova:creationTime>
Nov 28 13:56:56 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:56:56 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:56:56 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:56:56 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:56:56 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:56:56 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:56:56 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:56:56 user nova-compute[75453]:       <nova:owner>
Nov 28 13:56:56 user nova-compute[75453]:         <nova:user uuid="570ac6978fc249ba93d39e40d5d7eac7">tempest-VolumesSnapshotTestJSON-766520769-project-member</nova:user>
Nov 28 13:56:56 user nova-compute[75453]:         <nova:project uuid="ff4bdacb213b463cb88e3d046e931b9d">tempest-VolumesSnapshotTestJSON-766520769</nova:project>
Nov 28 13:56:56 user nova-compute[75453]:       </nova:owner>
Nov 28 13:56:56 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:56:56 user nova-compute[75453]:       <nova:ports>
Nov 28 13:56:56 user nova-compute[75453]:         <nova:port uuid="1543b940-0c84-4e66-b424-f3c6fbd8c737">
Nov 28 13:56:56 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 13:56:56 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:56 user nova-compute[75453]:       </nova:ports>
Nov 28 13:56:56 user nova-compute[75453]:     </nova:instance>
Nov 28 13:56:56 user nova-compute[75453]:   </metadata>
Nov 28 13:56:56 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:56:56 user nova-compute[75453]:     <system>
Nov 28 13:56:56 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:56:56 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:56:56 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:56:56 user nova-compute[75453]:       <entry name="serial">21bca975-80ab-4d17-8a2d-9435c5f9646f</entry>
Nov 28 13:56:56 user nova-compute[75453]:       <entry name="uuid">21bca975-80ab-4d17-8a2d-9435c5f9646f</entry>
Nov 28 13:56:56 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:56:56 user nova-compute[75453]:     </system>
Nov 28 13:56:56 user nova-compute[75453]:   </sysinfo>
Nov 28 13:56:56 user nova-compute[75453]:   <os>
Nov 28 13:56:56 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:56:56 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:56:56 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:56:56 user nova-compute[75453]:   </os>
Nov 28 13:56:56 user nova-compute[75453]:   <features>
Nov 28 13:56:56 user nova-compute[75453]:     <acpi/>
Nov 28 13:56:56 user nova-compute[75453]:     <apic/>
Nov 28 13:56:56 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:56:56 user nova-compute[75453]:   </features>
Nov 28 13:56:56 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:56:56 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:56:56 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:56:56 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:56:56 user nova-compute[75453]:   </clock>
Nov 28 13:56:56 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:56:56 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:56:56 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:56:56 user nova-compute[75453]:   </cpu>
Nov 28 13:56:56 user nova-compute[75453]:   <devices>
Nov 28 13:56:56 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:56:56 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:56:56 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk"/>
Nov 28 13:56:56 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:56:56 user nova-compute[75453]:     </disk>
Nov 28 13:56:56 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:56 user nova-compute[75453]:       <mac address="fa:16:3e:e5:c4:27"/>
Nov 28 13:56:56 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:56 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:56 user nova-compute[75453]:       <target dev="tap1543b940-0c"/>
Nov 28 13:56:56 user nova-compute[75453]:     </interface>
Nov 28 13:56:56 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:56:56 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/console.log" append="off"/>
Nov 28 13:56:56 user nova-compute[75453]:     </serial>
Nov 28 13:56:56 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:56:56 user nova-compute[75453]:     <video>
Nov 28 13:56:56 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:56 user nova-compute[75453]:     </video>
Nov 28 13:56:56 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:56:56 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:56:56 user nova-compute[75453]:     </rng>
Nov 28 13:56:56 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:56:56 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:56:56 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:56:56 user nova-compute[75453]:     </memballoon>
Nov 28 13:56:56 user nova-compute[75453]:   </devices>
Nov 28 13:56:56 user nova-compute[75453]: </domain>
Nov 28 13:56:56 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1509611543',display_name='tempest-VolumesSnapshotTestJSON-instance-1509611543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1509611543',id=11,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEZcduiQ4Bg+SyAMn1YHq4xZH858Iy0RGGFa+eLBzBoZOCJYpecnguM8KrxCXYdoPpgbGSlntpvAvtlnQy48NNkpQqMwqeZODnZhOhQ9HS/mZfIvCp+Xx38biZYtIPHOA==',key_name='tempest-keypair-1571158505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff4bdacb213b463cb88e3d046e931b9d',ramdisk_id='',reservation_id='r-q6pciizc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-766520769',owner_user_name='tempest-VolumesSnapshotTestJSON-766520769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='570ac6978fc249ba93d39e40d5d7eac7',uuid=21bca975-80ab-4d17-8a2d-9435c5f9646f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converting VIF {"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=1543b940-0c84-4e66-b424-f3c6fbd8c737,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1543b940-0c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_vif [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=1543b940-0c84-4e66-b424-f3c6fbd8c737,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1543b940-0c') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYhdaNnZ {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYhdaNnZ" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a4c06-feb3-44a0-b84d-9ef42bf6d494]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47990994-1c7b-5a76-8524-9f035c387502', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qYhdaNnZ'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1543b940-0c, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1543b940-0c, col_values=(('qos', UUID('d9392916-5d39-4fd1-b577-9b8746f28ed5')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1543b940-0c, col_values=(('external_ids', {'iface-id': '1543b940-0c84-4e66-b424-f3c6fbd8c737', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:c4:27', 'vm-uuid': '21bca975-80ab-4d17-8a2d-9435c5f9646f'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32dc1e4-c5d2-4c73-aa77-a1d3019a4137]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:56 user nova-compute[75453]: INFO os_vif [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=1543b940-0c84-4e66-b424-f3c6fbd8c737,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1543b940-0c')
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5e58f0-d11f-407c-9cec-4bf6f79f9e6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:56:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:56:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No VIF found with MAC fa:16:3e:e5:c4:27, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.network.neutron [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Updated VIF entry in instance network info cache for port 1543b940-0c84-4e66-b424-f3c6fbd8c737. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG nova.network.neutron [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Updating instance_info_cache with network_info: [{"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --login" returned: 0 in 0.270s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e6c4bd-7c30-4c4e-a013-dc557d14dcd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1, portal: 172.16.0.220,3260]
Nov 28 13:56:56 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1, portal: 172.16.0.220,3260] successful.
Nov 28 13:56:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-36d66343-8c02-42c7-bca8-8c95cdfb3299 req-349889ea-1402-48d5-afcb-976000b68722 service nova] Releasing lock "refresh_cache-21bca975-80ab-4d17-8a2d-9435c5f9646f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd82349-4550-4ae2-bb9b-e38d1a25f8fd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[82683d4d-2726-4ed4-a4ef-47f2064b17ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:56:56 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:56:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.580s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1857377-2b54-40c7-8e71-f7fe6cfbba0a]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:56:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYhdaNnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.616s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] <== connect_volume: return (1618ms) {'type': 'block', 'scsi_wwn': '26263643433653933', 'path': '/dev/sdg'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263643433653933', 'path': '/dev/sdg'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5a:6b,bridge_name='br-int',has_traffic_filtering=True,id=540a415e-6e64-4d9f-ba49-ec2a1a85439a,network=Network(b7880457-5d82-42a8-a9eb-7bd4fe365367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540a415e-6e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:cb:4c,bridge_name='br-int',has_traffic_filtering=True,id=c91797e6-0bbb-48ea-b5c2-278b0b4319ef,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc91797e6-0b') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0d:ae,bridge_name='br-int',has_traffic_filtering=True,id=605c90e8-31d1-4efa-b5c1-de9f7eeaec51,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap605c90e8-31') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a2:41,bridge_name='br-int',has_traffic_filtering=True,id=edf36fdd-4dd8-4465-8669-37b6adf82416,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf36fdd-4d') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:05:7e,bridge_name='br-int',has_traffic_filtering=True,id=9daa350f-1a8b-41c9-8fd4-52e99d65b25f,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9daa350f-1a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=a6e94133-9c6d-4d82-a2fe-56e7b65450bb,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e94133-9c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:b2:e5,bridge_name='br-int',has_traffic_filtering=True,id=494d17d8-bf46-4767-852b-4e578ef43377,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d17d8-bf') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.objects.instance [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lazy-loading 'pci_devices' on Instance uuid 794937d9-3c23-41cf-bb74-767e93bc1370 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:56:57 user nova-compute[75453]:   <uuid>794937d9-3c23-41cf-bb74-767e93bc1370</uuid>
Nov 28 13:56:57 user nova-compute[75453]:   <name>instance-0000000a</name>
Nov 28 13:56:57 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:56:57 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:56:57 user nova-compute[75453]:   <metadata>
Nov 28 13:56:57 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:56:57 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:56:57 user nova-compute[75453]:       <nova:name>tempest-device-tagging-server-493600760</nova:name>
Nov 28 13:56:57 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:56:53</nova:creationTime>
Nov 28 13:56:57 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:56:57 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:56:57 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:56:57 user nova-compute[75453]:       <nova:owner>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:user uuid="a16ed449c2e749fcafc01dd97b83241a">tempest-TaggedBootDevicesTest_v242-1237344816-project-member</nova:user>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:project uuid="112860fded124331bc667a597f4c695d">tempest-TaggedBootDevicesTest_v242-1237344816</nova:project>
Nov 28 13:56:57 user nova-compute[75453]:       </nova:owner>
Nov 28 13:56:57 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:56:57 user nova-compute[75453]:       <nova:ports>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:port uuid="540a415e-6e64-4d9f-ba49-ec2a1a85439a">
Nov 28 13:56:57 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 13:56:57 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:port uuid="c91797e6-0bbb-48ea-b5c2-278b0b4319ef">
Nov 28 13:56:57 user nova-compute[75453]:           <nova:ip type="fixed" address="10.1.1.209" ipVersion="4"/>
Nov 28 13:56:57 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:port uuid="605c90e8-31d1-4efa-b5c1-de9f7eeaec51">
Nov 28 13:56:57 user nova-compute[75453]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Nov 28 13:56:57 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:port uuid="edf36fdd-4dd8-4465-8669-37b6adf82416">
Nov 28 13:56:57 user nova-compute[75453]:           <nova:ip type="fixed" address="10.1.1.225" ipVersion="4"/>
Nov 28 13:56:57 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:port uuid="9daa350f-1a8b-41c9-8fd4-52e99d65b25f">
Nov 28 13:56:57 user nova-compute[75453]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Nov 28 13:56:57 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:port uuid="a6e94133-9c6d-4d82-a2fe-56e7b65450bb">
Nov 28 13:56:57 user nova-compute[75453]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 13:56:57 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:57 user nova-compute[75453]:         <nova:port uuid="494d17d8-bf46-4767-852b-4e578ef43377">
Nov 28 13:56:57 user nova-compute[75453]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 13:56:57 user nova-compute[75453]:         </nova:port>
Nov 28 13:56:57 user nova-compute[75453]:       </nova:ports>
Nov 28 13:56:57 user nova-compute[75453]:     </nova:instance>
Nov 28 13:56:57 user nova-compute[75453]:   </metadata>
Nov 28 13:56:57 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:56:57 user nova-compute[75453]:     <system>
Nov 28 13:56:57 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:56:57 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:56:57 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:56:57 user nova-compute[75453]:       <entry name="serial">794937d9-3c23-41cf-bb74-767e93bc1370</entry>
Nov 28 13:56:57 user nova-compute[75453]:       <entry name="uuid">794937d9-3c23-41cf-bb74-767e93bc1370</entry>
Nov 28 13:56:57 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:56:57 user nova-compute[75453]:     </system>
Nov 28 13:56:57 user nova-compute[75453]:   </sysinfo>
Nov 28 13:56:57 user nova-compute[75453]:   <os>
Nov 28 13:56:57 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:56:57 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:56:57 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:56:57 user nova-compute[75453]:   </os>
Nov 28 13:56:57 user nova-compute[75453]:   <features>
Nov 28 13:56:57 user nova-compute[75453]:     <acpi/>
Nov 28 13:56:57 user nova-compute[75453]:     <apic/>
Nov 28 13:56:57 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:56:57 user nova-compute[75453]:   </features>
Nov 28 13:56:57 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:56:57 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:56:57 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:56:57 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:56:57 user nova-compute[75453]:   </clock>
Nov 28 13:56:57 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:56:57 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:56:57 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:56:57 user nova-compute[75453]:   </cpu>
Nov 28 13:56:57 user nova-compute[75453]:   <devices>
Nov 28 13:56:57 user nova-compute[75453]:     <disk type="file" device="cdrom">
Nov 28 13:56:57 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 13:56:57 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/794937d9-3c23-41cf-bb74-767e93bc1370/disk.config"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="hda" bus="ide"/>
Nov 28 13:56:57 user nova-compute[75453]:     </disk>
Nov 28 13:56:57 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 13:56:57 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:56:57 user nova-compute[75453]:       <source dev="/dev/sde"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <serial>46ef3fc0-9e51-4dec-bb48-5113d0dde6ab</serial>
Nov 28 13:56:57 user nova-compute[75453]:     </disk>
Nov 28 13:56:57 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 13:56:57 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:56:57 user nova-compute[75453]:       <source dev="/dev/sdf"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <serial>f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e</serial>
Nov 28 13:56:57 user nova-compute[75453]:     </disk>
Nov 28 13:56:57 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 13:56:57 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:56:57 user nova-compute[75453]:       <source dev="/dev/sdg"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="vdc" bus="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <serial>c4143e1d-5911-4ff6-a035-e7c81788faa1</serial>
Nov 28 13:56:57 user nova-compute[75453]:     </disk>
Nov 28 13:56:57 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:57 user nova-compute[75453]:       <mac address="fa:16:3e:db:5a:6b"/>
Nov 28 13:56:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="tap540a415e-6e"/>
Nov 28 13:56:57 user nova-compute[75453]:     </interface>
Nov 28 13:56:57 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:57 user nova-compute[75453]:       <mac address="fa:16:3e:78:cb:4c"/>
Nov 28 13:56:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="tapc91797e6-0b"/>
Nov 28 13:56:57 user nova-compute[75453]:     </interface>
Nov 28 13:56:57 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:57 user nova-compute[75453]:       <mac address="fa:16:3e:dd:0d:ae"/>
Nov 28 13:56:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="tap605c90e8-31"/>
Nov 28 13:56:57 user nova-compute[75453]:     </interface>
Nov 28 13:56:57 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:57 user nova-compute[75453]:       <mac address="fa:16:3e:13:a2:41"/>
Nov 28 13:56:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="tapedf36fdd-4d"/>
Nov 28 13:56:57 user nova-compute[75453]:     </interface>
Nov 28 13:56:57 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:57 user nova-compute[75453]:       <mac address="fa:16:3e:0c:05:7e"/>
Nov 28 13:56:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="tap9daa350f-1a"/>
Nov 28 13:56:57 user nova-compute[75453]:     </interface>
Nov 28 13:56:57 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:57 user nova-compute[75453]:       <mac address="fa:16:3e:fc:c0:0d"/>
Nov 28 13:56:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="tapa6e94133-9c"/>
Nov 28 13:56:57 user nova-compute[75453]:     </interface>
Nov 28 13:56:57 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:56:57 user nova-compute[75453]:       <mac address="fa:16:3e:67:b2:e5"/>
Nov 28 13:56:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:56:57 user nova-compute[75453]:       <target dev="tap494d17d8-bf"/>
Nov 28 13:56:57 user nova-compute[75453]:     </interface>
Nov 28 13:56:57 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:56:57 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/794937d9-3c23-41cf-bb74-767e93bc1370/console.log" append="off"/>
Nov 28 13:56:57 user nova-compute[75453]:     </serial>
Nov 28 13:56:57 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:56:57 user nova-compute[75453]:     <video>
Nov 28 13:56:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:56:57 user nova-compute[75453]:     </video>
Nov 28 13:56:57 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:56:57 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:56:57 user nova-compute[75453]:     </rng>
Nov 28 13:56:57 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:56:57 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:56:57 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:56:57 user nova-compute[75453]:     </memballoon>
Nov 28 13:56:57 user nova-compute[75453]:   </devices>
Nov 28 13:56:57 user nova-compute[75453]: </domain>
Nov 28 13:56:57 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5a:6b,bridge_name='br-int',has_traffic_filtering=True,id=540a415e-6e64-4d9f-ba49-ec2a1a85439a,network=Network(b7880457-5d82-42a8-a9eb-7bd4fe365367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540a415e-6e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5a:6b,bridge_name='br-int',has_traffic_filtering=True,id=540a415e-6e64-4d9f-ba49-ec2a1a85439a,network=Network(b7880457-5d82-42a8-a9eb-7bd4fe365367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540a415e-6e') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6538af56-aba1-5b98-a940-57889a35849e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap540a415e-6e, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap540a415e-6e, col_values=(('qos', UUID('e6e40dab-1dc3-475f-9cd5-bb995d09e90a')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap540a415e-6e, col_values=(('external_ids', {'iface-id': '540a415e-6e64-4d9f-ba49-ec2a1a85439a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:5a:6b', 'vm-uuid': '794937d9-3c23-41cf-bb74-767e93bc1370'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: INFO os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5a:6b,bridge_name='br-int',has_traffic_filtering=True,id=540a415e-6e64-4d9f-ba49-ec2a1a85439a,network=Network(b7880457-5d82-42a8-a9eb-7bd4fe365367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540a415e-6e')
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:cb:4c,bridge_name='br-int',has_traffic_filtering=True,id=c91797e6-0bbb-48ea-b5c2-278b0b4319ef,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc91797e6-0b') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cb:4c,bridge_name='br-int',has_traffic_filtering=True,id=c91797e6-0bbb-48ea-b5c2-278b0b4319ef,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc91797e6-0b') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3517d8b-a1ac-5dc5-9d0f-f5359d08f668', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc91797e6-0b, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc91797e6-0b, col_values=(('qos', UUID('ccd33cde-7067-4134-aea9-3dc4533c0041')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc91797e6-0b, col_values=(('external_ids', {'iface-id': 'c91797e6-0bbb-48ea-b5c2-278b0b4319ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:cb:4c', 'vm-uuid': '794937d9-3c23-41cf-bb74-767e93bc1370'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: INFO os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cb:4c,bridge_name='br-int',has_traffic_filtering=True,id=c91797e6-0bbb-48ea-b5c2-278b0b4319ef,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc91797e6-0b')
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0d:ae,bridge_name='br-int',has_traffic_filtering=True,id=605c90e8-31d1-4efa-b5c1-de9f7eeaec51,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap605c90e8-31') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0d:ae,bridge_name='br-int',has_traffic_filtering=True,id=605c90e8-31d1-4efa-b5c1-de9f7eeaec51,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap605c90e8-31') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd234dfc-b851-504b-a234-cb57cb94f70f', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap605c90e8-31, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap605c90e8-31, col_values=(('qos', UUID('4ec48ba8-25e6-46b0-bfc1-1d7847275fa1')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap605c90e8-31, col_values=(('external_ids', {'iface-id': '605c90e8-31d1-4efa-b5c1-de9f7eeaec51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:0d:ae', 'vm-uuid': '794937d9-3c23-41cf-bb74-767e93bc1370'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: INFO os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0d:ae,bridge_name='br-int',has_traffic_filtering=True,id=605c90e8-31d1-4efa-b5c1-de9f7eeaec51,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap605c90e8-31')
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a2:41,bridge_name='br-int',has_traffic_filtering=True,id=edf36fdd-4dd8-4465-8669-37b6adf82416,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf36fdd-4d') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a2:41,bridge_name='br-int',has_traffic_filtering=True,id=edf36fdd-4dd8-4465-8669-37b6adf82416,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf36fdd-4d') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '139818d3-ca5a-59ef-b013-e7f3b389efcf', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedf36fdd-4d, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedf36fdd-4d, col_values=(('qos', UUID('a69ce2c8-b008-4382-83ad-bc07deb642e7')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedf36fdd-4d, col_values=(('external_ids', {'iface-id': 'edf36fdd-4dd8-4465-8669-37b6adf82416', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:a2:41', 'vm-uuid': '794937d9-3c23-41cf-bb74-767e93bc1370'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received event network-vif-plugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] No waiting events found dispatching network-vif-plugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:56:58 user nova-compute[75453]: WARNING nova.compute.manager [req-4eeddf67-9af1-4b89-be94-172c75b86836 req-4a98035b-a1d2-4168-b90d-85800688db2b service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received unexpected event network-vif-plugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance with vm_state building and task_state spawning.
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: INFO os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a2:41,bridge_name='br-int',has_traffic_filtering=True,id=edf36fdd-4dd8-4465-8669-37b6adf82416,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf36fdd-4d')
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:05:7e,bridge_name='br-int',has_traffic_filtering=True,id=9daa350f-1a8b-41c9-8fd4-52e99d65b25f,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9daa350f-1a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:05:7e,bridge_name='br-int',has_traffic_filtering=True,id=9daa350f-1a8b-41c9-8fd4-52e99d65b25f,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9daa350f-1a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53ba86ba-8b12-518a-8ae5-4922fbb6539e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9daa350f-1a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9daa350f-1a, col_values=(('qos', UUID('9f3e4bda-df8c-44d7-90fc-e93395bff1c6')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9daa350f-1a, col_values=(('external_ids', {'iface-id': '9daa350f-1a8b-41c9-8fd4-52e99d65b25f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:05:7e', 'vm-uuid': '794937d9-3c23-41cf-bb74-767e93bc1370'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: INFO os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:05:7e,bridge_name='br-int',has_traffic_filtering=True,id=9daa350f-1a8b-41c9-8fd4-52e99d65b25f,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9daa350f-1a')
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=a6e94133-9c6d-4d82-a2fe-56e7b65450bb,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e94133-9c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=a6e94133-9c6d-4d82-a2fe-56e7b65450bb,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e94133-9c') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7bc2f1c-6177-5c67-ba2e-7f1d47ebada6', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6e94133-9c, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6e94133-9c, col_values=(('qos', UUID('53675b7d-6892-4f91-8ea9-264c54fcdc1e')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6e94133-9c, col_values=(('external_ids', {'iface-id': 'a6e94133-9c6d-4d82-a2fe-56e7b65450bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:c0:0d', 'vm-uuid': '794937d9-3c23-41cf-bb74-767e93bc1370'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: INFO os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=a6e94133-9c6d-4d82-a2fe-56e7b65450bb,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e94133-9c')
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:56:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:b2:e5,bridge_name='br-int',has_traffic_filtering=True,id=494d17d8-bf46-4767-852b-4e578ef43377,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d17d8-bf') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:b2:e5,bridge_name='br-int',has_traffic_filtering=True,id=494d17d8-bf46-4767-852b-4e578ef43377,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d17d8-bf') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5267522-9336-5ae8-a03b-0dc8450a045b', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap494d17d8-bf, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap494d17d8-bf, col_values=(('qos', UUID('8735f15b-7d85-4e36-9571-8bf31b169b1c')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap494d17d8-bf, col_values=(('external_ids', {'iface-id': '494d17d8-bf46-4767-852b-4e578ef43377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:b2:e5', 'vm-uuid': '794937d9-3c23-41cf-bb74-767e93bc1370'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:56:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:56:59 user nova-compute[75453]: INFO os_vif [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:b2:e5,bridge_name='br-int',has_traffic_filtering=True,id=494d17d8-bf46-4767-852b-4e578ef43377,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d17d8-bf')
Nov 28 13:56:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] No BDM found with device name hda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:56:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:56:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] No VIF found with MAC fa:16:3e:db:5a:6b, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:56:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] No VIF found with MAC fa:16:3e:0c:05:7e, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:56:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Using config drive
Nov 28 13:56:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Creating config drive at /opt/stack/data/nova/instances/794937d9-3c23-41cf-bb74-767e93bc1370/disk.config
Nov 28 13:56:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/794937d9-3c23-41cf-bb74-767e93bc1370/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpve3p_z6z {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:56:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:56:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/794937d9-3c23-41cf-bb74-767e93bc1370/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpve3p_z6z" returned: 0 in 0.051s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:57:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Instance spawned successfully.
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received event network-vif-plugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] No waiting events found dispatching network-vif-plugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:00 user nova-compute[75453]: WARNING nova.compute.manager [req-061d322c-8624-40bd-a426-8f3c1abd5ee5 req-699dabaa-c642-407a-ad8b-6f59aa463eb9 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received unexpected event network-vif-plugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance with vm_state building and task_state spawning.
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 13:57:00 user nova-compute[75453]: INFO nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:57:00 user nova-compute[75453]: INFO nova.compute.claims [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Claim successful on node user
Nov 28 13:57:00 user nova-compute[75453]: INFO nova.compute.manager [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Took 6.88 seconds to build instance.
Nov 28 13:57:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40d2c472-589b-4076-8f20-10150f0b71ce tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.987s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG nova.network.neutron [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:57:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:57:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG nova.policy [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '237e50c8ccfa49169a1bdca99f46e616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9642956daa4507a3b6791bcd41d9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:57:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Creating image(s)
Nov 28 13:57:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "/opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "/opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "/opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.232s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.280s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk 1073741824" returned: 0 in 0.079s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:02 user nova-compute[75453]: WARNING nova.compute.manager [req-bbd82271-d1aa-4baf-aed8-b2d45fcb613c req-08cd427d-eaa5-46c3-8ec3-b650b592b41c service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 for instance with vm_state building and task_state spawning.
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.259s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-changed-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Refreshing instance network info cache due to event network-changed-56d8de7f-0f8a-4f2e-8890-405ec6cb9294. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Acquiring lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Acquired lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Refreshing network info cache for port 56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Cannot resize image /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Ensure instance console log exists: /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG nova.network.neutron [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Successfully created port: 9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:04 user nova-compute[75453]: WARNING nova.compute.manager [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 for instance with vm_state building and task_state spawning.
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:04 user nova-compute[75453]: WARNING nova.compute.manager [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-edf36fdd-4dd8-4465-8669-37b6adf82416 for instance with vm_state building and task_state spawning.
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:04 user nova-compute[75453]: WARNING nova.compute.manager [req-2ce557cc-4e1b-4143-afae-c15d9a594cc6 req-37a9cf55-fbcf-48f7-97fb-abaf9018b308 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-edf36fdd-4dd8-4465-8669-37b6adf82416 for instance with vm_state building and task_state spawning.
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:04 user nova-compute[75453]: WARNING nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef for instance with vm_state building and task_state spawning.
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:04 user nova-compute[75453]: WARNING nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance with vm_state building and task_state spawning.
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-changed-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Refreshing instance network info cache due to event network-changed-36d6817d-5a86-4e22-90cd-adfe2b3f176e. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Acquiring lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Acquired lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.network.neutron [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Refreshing network info cache for port 36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:57:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:05 user nova-compute[75453]: WARNING nova.compute.manager [req-9bb41b36-0b50-45e3-9b1e-bcd9da7dd2a4 req-6b491555-99f9-4b85-a725-23ba2b93aa41 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance with vm_state building and task_state spawning.
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.network.neutron [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updated VIF entry in instance network info cache for port 56d8de7f-0f8a-4f2e-8890-405ec6cb9294. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.network.neutron [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating instance_info_cache with network_info: [{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Releasing lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:05 user nova-compute[75453]: WARNING nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance with vm_state building and task_state spawning.
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:05 user nova-compute[75453]: WARNING nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance with vm_state building and task_state spawning.
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:05 user nova-compute[75453]: WARNING nova.compute.manager [req-b248ac3b-4de5-451a-ba37-ece7bc4cfed9 req-67c76882-8cb5-48dc-aad6-507a35097d50 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef for instance with vm_state building and task_state spawning.
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Successfully updated port: 9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json" returned: 0 in 0.548s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:06 user nova-compute[75453]: INFO nova.compute.manager [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Attaching volume a6dd3f41-6624-4976-8316-6d52ce2c4373 to /dev/vdb
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "refresh_cache-eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquired lock "refresh_cache-eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG os_brick.utils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updated VIF entry in instance network info cache for port 36d6817d-5a86-4e22-90cd-adfe2b3f176e. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance_info_cache with network_info: [{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[89127a60-1f96-4653-a545-b30e08fb0d2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ac62fd-e3b0-4e4c-90bb-a42d7a2b787b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Releasing lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:06 user nova-compute[75453]: WARNING nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance with vm_state building and task_state spawning.
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:06 user nova-compute[75453]: WARNING nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-494d17d8-bf46-4767-852b-4e578ef43377 for instance with vm_state building and task_state spawning.
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:06 user nova-compute[75453]: WARNING nova.compute.manager [req-389e225e-a51e-471d-9508-90e75fbb0920 req-54170f25-68ab-4db6-809f-b03bc9a5267d service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-494d17d8-bf46-4767-852b-4e578ef43377 for instance with vm_state building and task_state spawning.
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fabcf37-9b99-4320-9dd5-9b534132eb00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c216dd-91c6-4a69-a0eb-6cdf97ceedfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:06 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a83b88-c670-4cf4-b904-793781dd6d94]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG os_brick.utils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating existing volume attachment record: 5deb5279-8d0e-4325-8772-26ec7b02fe27 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:57:06 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance spawned successfully.
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Updating instance_info_cache with network_info: [{"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Releasing lock "refresh_cache-eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Instance network_info: |[{"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Start _get_guest_xml network_info=[{"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:57:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:57:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1115132190',display_name='tempest-ServersNegativeTestJSON-server-1115132190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1115132190',id=12,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f9642956daa4507a3b6791bcd41d9d3',ramdisk_id='',reservation_id='r-f410lr8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2071230602',owner_user_name='tempest-ServersNegativeTestJSON-2071230602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:57:01Z,user_data=None,user_id='237e50c8ccfa49169a1bdca99f46e616',uuid=eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converting VIF {"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:90,bridge_name='br-int',has_traffic_filtering=True,id=9729fc6f-4406-4ec7-9f32-1938bd85d524,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9729fc6f-44') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.objects.instance [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lazy-loading 'pci_devices' on Instance uuid eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:57:06 user nova-compute[75453]:   <uuid>eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b</uuid>
Nov 28 13:57:06 user nova-compute[75453]:   <name>instance-0000000c</name>
Nov 28 13:57:06 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:57:06 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:57:06 user nova-compute[75453]:   <metadata>
Nov 28 13:57:06 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:57:06 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:57:06 user nova-compute[75453]:       <nova:name>tempest-ServersNegativeTestJSON-server-1115132190</nova:name>
Nov 28 13:57:06 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:57:06</nova:creationTime>
Nov 28 13:57:06 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:57:06 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:57:06 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:57:06 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:57:06 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:57:06 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:57:06 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:57:06 user nova-compute[75453]:       <nova:owner>
Nov 28 13:57:06 user nova-compute[75453]:         <nova:user uuid="237e50c8ccfa49169a1bdca99f46e616">tempest-ServersNegativeTestJSON-2071230602-project-member</nova:user>
Nov 28 13:57:06 user nova-compute[75453]:         <nova:project uuid="0f9642956daa4507a3b6791bcd41d9d3">tempest-ServersNegativeTestJSON-2071230602</nova:project>
Nov 28 13:57:06 user nova-compute[75453]:       </nova:owner>
Nov 28 13:57:06 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:57:06 user nova-compute[75453]:       <nova:ports>
Nov 28 13:57:06 user nova-compute[75453]:         <nova:port uuid="9729fc6f-4406-4ec7-9f32-1938bd85d524">
Nov 28 13:57:06 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 13:57:06 user nova-compute[75453]:         </nova:port>
Nov 28 13:57:06 user nova-compute[75453]:       </nova:ports>
Nov 28 13:57:06 user nova-compute[75453]:     </nova:instance>
Nov 28 13:57:06 user nova-compute[75453]:   </metadata>
Nov 28 13:57:06 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:57:06 user nova-compute[75453]:     <system>
Nov 28 13:57:06 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:57:06 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:57:06 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:57:06 user nova-compute[75453]:       <entry name="serial">eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b</entry>
Nov 28 13:57:06 user nova-compute[75453]:       <entry name="uuid">eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b</entry>
Nov 28 13:57:06 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:57:06 user nova-compute[75453]:     </system>
Nov 28 13:57:06 user nova-compute[75453]:   </sysinfo>
Nov 28 13:57:06 user nova-compute[75453]:   <os>
Nov 28 13:57:06 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:57:06 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:57:06 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:57:06 user nova-compute[75453]:   </os>
Nov 28 13:57:06 user nova-compute[75453]:   <features>
Nov 28 13:57:06 user nova-compute[75453]:     <acpi/>
Nov 28 13:57:06 user nova-compute[75453]:     <apic/>
Nov 28 13:57:06 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:57:06 user nova-compute[75453]:   </features>
Nov 28 13:57:06 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:57:06 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:57:06 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:57:06 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:57:06 user nova-compute[75453]:   </clock>
Nov 28 13:57:06 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:57:06 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:57:06 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:57:06 user nova-compute[75453]:   </cpu>
Nov 28 13:57:06 user nova-compute[75453]:   <devices>
Nov 28 13:57:06 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:57:06 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:57:06 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk"/>
Nov 28 13:57:06 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:57:06 user nova-compute[75453]:     </disk>
Nov 28 13:57:06 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:57:06 user nova-compute[75453]:       <mac address="fa:16:3e:38:b9:90"/>
Nov 28 13:57:06 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:57:06 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:57:06 user nova-compute[75453]:       <target dev="tap9729fc6f-44"/>
Nov 28 13:57:06 user nova-compute[75453]:     </interface>
Nov 28 13:57:06 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:57:06 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/console.log" append="off"/>
Nov 28 13:57:06 user nova-compute[75453]:     </serial>
Nov 28 13:57:06 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:57:06 user nova-compute[75453]:     <video>
Nov 28 13:57:06 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:57:06 user nova-compute[75453]:     </video>
Nov 28 13:57:06 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:57:06 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:57:06 user nova-compute[75453]:     </rng>
Nov 28 13:57:06 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:57:06 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:57:06 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:57:06 user nova-compute[75453]:     </memballoon>
Nov 28 13:57:06 user nova-compute[75453]:   </devices>
Nov 28 13:57:06 user nova-compute[75453]: </domain>
Nov 28 13:57:06 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1115132190',display_name='tempest-ServersNegativeTestJSON-server-1115132190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1115132190',id=12,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f9642956daa4507a3b6791bcd41d9d3',ramdisk_id='',reservation_id='r-f410lr8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2071230602',owner_user_name='tempest-ServersNegativeTestJSON-2071230602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:57:01Z,user_data=None,user_id='237e50c8ccfa49169a1bdca99f46e616',uuid=eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converting VIF {"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:90,bridge_name='br-int',has_traffic_filtering=True,id=9729fc6f-4406-4ec7-9f32-1938bd85d524,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9729fc6f-44') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG os_vif [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:90,bridge_name='br-int',has_traffic_filtering=True,id=9729fc6f-4406-4ec7-9f32-1938bd85d524,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9729fc6f-44') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '272aef34-d7b4-5bc6-b137-36fd352011b4', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:06 user nova-compute[75453]: INFO nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Took 13.45 seconds to spawn the instance on the hypervisor.
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9729fc6f-44, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9729fc6f-44, col_values=(('qos', UUID('ad7ed009-2d39-4da8-8a41-2be355ca0328')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9729fc6f-44, col_values=(('external_ids', {'iface-id': '9729fc6f-4406-4ec7-9f32-1938bd85d524', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:b9:90', 'vm-uuid': 'eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:06 user nova-compute[75453]: INFO os_vif [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:90,bridge_name='br-int',has_traffic_filtering=True,id=9729fc6f-4406-4ec7-9f32-1938bd85d524,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9729fc6f-44')
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] No VIF found with MAC fa:16:3e:38:b9:90, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:57:06 user nova-compute[75453]: INFO nova.compute.manager [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Took 51.13 seconds to build instance.
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ace6bdc-fa72-4438-9746-7ef8dbdf75c1 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "794937d9-3c23-41cf-bb74-767e93bc1370" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.252s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:07 user nova-compute[75453]: WARNING nova.compute.manager [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance with vm_state active and task_state None.
Nov 28 13:57:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received event network-changed-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Refreshing instance network info cache due to event network-changed-9729fc6f-4406-4ec7-9f32-1938bd85d524. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Acquiring lock "refresh_cache-eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Acquired lock "refresh_cache-eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG nova.network.neutron [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Refreshing network info cache for port 9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG nova.network.neutron [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Updated VIF entry in instance network info cache for port 9729fc6f-4406-4ec7-9f32-1938bd85d524. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG nova.network.neutron [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Updating instance_info_cache with network_info: [{"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ae41ebe5-7589-462d-be25-f54a1aeb04a0 req-ce345d97-7152-4801-a9f1-d2d4026d5381 service nova] Releasing lock "refresh_cache-eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received event network-vif-plugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] Acquiring lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] No waiting events found dispatching network-vif-plugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:09 user nova-compute[75453]: WARNING nova.compute.manager [req-31362843-42e8-4bee-bfd3-a8474a0e0fd5 req-b8a1d25b-6eb9-4258-8eb3-bffa67d0f08a service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received unexpected event network-vif-plugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance with vm_state building and task_state spawning.
Nov 28 13:57:09 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:57:09 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7228MB free_disk=25.552139282226562GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 48dd0221-4935-4ee2-9958-90a748fe5255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 949a3612-5042-420f-9911-ec641017d399 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance a9a21b61-5815-47ed-adac-040b1fc8e33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 66c010a7-3604-41c4-9599-d41172a28fe2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 794937d9-3c23-41cf-bb74-767e93bc1370 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 21bca975-80ab-4d17-8a2d-9435c5f9646f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 13:57:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 13:57:10 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:57:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:57:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 13:57:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:57:11 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Instance spawned successfully.
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:11 user nova-compute[75453]: INFO nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Took 9.56 seconds to spawn the instance on the hypervisor.
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received event network-vif-plugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] Acquiring lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] No waiting events found dispatching network-vif-plugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:11 user nova-compute[75453]: WARNING nova.compute.manager [req-f33a972e-8499-498f-ad6c-30db5fc5969d req-0ddf7331-a63a-40fc-9dc2-da9c42f8e345 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received unexpected event network-vif-plugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance with vm_state building and task_state spawning.
Nov 28 13:57:11 user nova-compute[75453]: INFO nova.compute.manager [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Took 10.78 seconds to build instance.
Nov 28 13:57:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-57b96c21-42e0-4d0c-9f41-1161c6562a27 tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.009s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating instance_info_cache with network_info: [{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received event network-changed-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Refreshing instance network info cache due to event network-changed-c4432eb7-3703-49b9-afd1-534fdd4065b4. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] Acquiring lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] Acquired lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:12 user nova-compute[75453]: DEBUG nova.network.neutron [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Refreshing network info cache for port c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:13 user nova-compute[75453]: DEBUG nova.network.neutron [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Updated VIF entry in instance network info cache for port c4432eb7-3703-49b9-afd1-534fdd4065b4. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:13 user nova-compute[75453]: DEBUG nova.network.neutron [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Updating instance_info_cache with network_info: [{"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c16d6916-8ce7-4afa-afb3-f743cfa4f385 req-31808bee-b07c-492e-b02e-27d6fee7e9aa service nova] Releasing lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "949a3612-5042-420f-9911-ec641017d399" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.007s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:15 user nova-compute[75453]: DEBUG nova.objects.instance [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'flavor' on Instance uuid 949a3612-5042-420f-9911-ec641017d399 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UODdnTXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:16 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:16 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:16 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-changed-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Refreshing instance network info cache due to event network-changed-b0710703-b905-47cd-bf04-c07eb065364e. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] Acquiring lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] Acquired lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG nova.network.neutron [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Refreshing network info cache for port b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[26917f29-150c-411c-8376-dc0d0146b06e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:57:16 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "949a3612-5042-420f-9911-ec641017d399" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:16 user nova-compute[75453]: INFO nova.compute.manager [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Attaching volume ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 to /dev/vdb
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39e31d6-63dc-48c7-907a-9dfc53a11284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373] added
Nov 28 13:57:16 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d17ed9-c3bd-433c-bade-3268df05c8c2]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78f5e11-70e0-49c3-94f2-78349c0adf67]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UODdnTXi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.utils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c65c3-22e6-49c9-bd3c-8bca4fff8cfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UODdnTXi" returned: 0 in 0.038s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce0c00-be4d-4804-9817-0f59b6805b6e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UODdnTXi'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6201f1be-d86a-4118-bad7-e1a58bc3828e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dedc9b5-811c-4ae7-abf9-e25ba622a586]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bffdc5-6990-45e9-b57a-b564801b8834]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[86162b9a-35d4-4709-827c-0e803fee19c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[961bb463-5a03-4cba-9b23-b167dfde2b38]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:16 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d85993-9735-427d-9e23-85fbdac074d2]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.utils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Updating existing volume attachment record: 56ff2812-4958-45f1-8879-9699450c2493 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ef0c4f-a0c3-48c2-8869-46d2f858df45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260]
Nov 28 13:57:16 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260] successful.
Nov 28 13:57:16 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0be84fd-8298-4e19-84c3-1f3c56914c57]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0816552e-2983-41aa-a2af-9b42755cc941]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:16 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.559s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb2d711-1cff-4359-ba32-52844bafe300]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:57:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UODdnTXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:57:17 user nova-compute[75453]: DEBUG nova.network.neutron [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Updated VIF entry in instance network info cache for port b0710703-b905-47cd-bf04-c07eb065364e. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:17 user nova-compute[75453]: DEBUG nova.network.neutron [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Updating instance_info_cache with network_info: [{"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2c009a40-264e-4f01-a4f7-54fbcd1cfbf6 req-b68cafe3-eace-4e2e-827f-bb58a4e808a9 service nova] Releasing lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.633s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== connect_volume: return (1636ms) {'type': 'block', 'scsi_wwn': '26161343161333761', 'path': '/dev/sdh'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161343161333761', 'path': '/dev/sdh'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:57:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 13:57:17 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:17 user nova-compute[75453]:   <source dev="/dev/sdh"/>
Nov 28 13:57:17 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:17 user nova-compute[75453]:   <serial>a6dd3f41-6624-4976-8316-6d52ce2c4373</serial>
Nov 28 13:57:17 user nova-compute[75453]: </disk>
Nov 28 13:57:17 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 13:57:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No VIF found with MAC fa:16:3e:bd:18:5b, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f1a9e8b5-c33a-459c-831d-36d580eb20c6 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.994s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG nova.objects.instance [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lazy-loading 'flavor' on Instance uuid 3907babd-71af-4fca-8ad7-4a7dae1710d6 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:19 user nova-compute[75453]: INFO nova.compute.manager [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Attaching volume fd388849-316c-483a-a70e-77373ca06f10 to /dev/vdb
Nov 28 13:57:19 user nova-compute[75453]: DEBUG os_brick.utils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0455cb71-9db4-4bf6-ae84-ec252b79da71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d38cac-98f4-46c5-a3a2-6e301fc4c4c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79c7f71-f897-4285-81fb-f88e902d1ef1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[654d0a03-b594-43eb-a3e1-3c4cf65eff18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:19 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:57:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[85185f8d-c20b-4fef-922c-1194092303ab]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG os_brick.utils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:19 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Updating existing volume attachment record: 6ec5d1cc-c85f-48f1-9281-603bc4f8785f {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75453) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG nova.objects.instance [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-unplugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-unplugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:21 user nova-compute[75453]: WARNING nova.compute.manager [req-294c23ea-89e5-42e2-9ff4-a097a9ae6b95 req-77bec625-d3f1-4b0d-afec-d054a8860284 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-unplugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state active and task_state powering-off.
Nov 28 13:57:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:21 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance destroyed successfully.
Nov 28 13:57:21 user nova-compute[75453]: DEBUG nova.compute.manager [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:57:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44904890-1027-462a-a2ad-1b1c19b96865 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.276s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:23 user nova-compute[75453]: WARNING nova.compute.manager [req-1210a8b5-1d89-4f03-97e3-f2b84f1d1db9 req-618098b1-feb9-4edb-abc5-1e6291606c6b service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state stopped and task_state None.
Nov 28 13:57:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUPHafOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:25 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:25 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:25 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9701b57f-6ebd-45b0-ad3a-c6801f869198]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:57:25 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc804e6-a561-4bde-a92b-317c09b79fe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6] added
Nov 28 13:57:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8206890c-acfb-450d-8bd8-6c4d4fe0e088]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a869dd1-f8d7-4810-8d55-92d64fec1066]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUPHafOj {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUPHafOj" returned: 0 in 0.040s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b022f3f-6eec-4833-bab2-195ccee4c253]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUPHafOj'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[831a71f9-0a14-4664-8192-e155cd02f6b5]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddf3989-6ddf-48dd-ac72-6faa76154433]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa90fcb-b935-434b-90e0-f9a2c9244a8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6, portal: 172.16.0.220,3260]
Nov 28 13:57:25 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6, portal: 172.16.0.220,3260] successful.
Nov 28 13:57:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4625ad93-0515-4008-8705-e0929444eecf]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04fcc72-2c19-48e0-991a-8ef626ef9686]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[af07d2f7-aaed-4341-af52-e468e023309f]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:57:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUPHafOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:57:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23437346562633737', 'path': '/dev/sdi'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437346562633737', 'path': '/dev/sdi'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:57:26 user nova-compute[75453]: DEBUG nova.objects.instance [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'flavor' on Instance uuid 949a3612-5042-420f-9911-ec641017d399 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 13:57:26 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:26 user nova-compute[75453]:   <source dev="/dev/sdi"/>
Nov 28 13:57:26 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:26 user nova-compute[75453]:   <serial>ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6</serial>
Nov 28 13:57:26 user nova-compute[75453]: </disk>
Nov 28 13:57:26 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 13:57:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No VIF found with MAC fa:16:3e:83:c2:36, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:57:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-120cd4c0-bdf3-4650-9bad-6eabf5e78afd tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.162s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvJknzKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:28 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:28 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:28 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:28 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:28 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:57:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b316dd-38f9-41c8-b691-adc9ab5bd42a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:57:28 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aecc2f-a393-4bf5-8043-2f10b65b9178]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:28 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10] added
Nov 28 13:57:28 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7214123-ecd2-4d25-8428-3fb252ea8e86]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4c4d68-ffe9-4f01-b383-f0fccbf8da2a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvJknzKs {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvJknzKs" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75c3f4d-e0a4-45f7-92d0-93517e5812fe]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvJknzKs'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5849b2-b39f-4e28-b134-46c59991e6a5]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3665a031-7958-477d-bb2a-c2160ef9f477]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --login" returned: 0 in 0.264s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0d1e49-05da-4ebe-8be1-8f36d1b4d6d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10, portal: 172.16.0.220,3260]
Nov 28 13:57:29 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10, portal: 172.16.0.220,3260] successful.
Nov 28 13:57:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f277226d-016c-4162-9612-5715644ebf17]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[471a2afd-73af-431a-8a87-eb199d32a842]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.516s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.114s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[213e05d3-bd28-48ea-8a26-69d972de2859]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:57:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvJknzKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.653s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] <== connect_volume: return (1654ms) {'type': 'block', 'scsi_wwn': '26534396265656533', 'path': '/dev/sdj'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534396265656533', 'path': '/dev/sdj'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG nova.objects.instance [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lazy-loading 'flavor' on Instance uuid 3907babd-71af-4fca-8ad7-4a7dae1710d6 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 13:57:30 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:30 user nova-compute[75453]:   <source dev="/dev/sdj"/>
Nov 28 13:57:30 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:30 user nova-compute[75453]:   <serial>fd388849-316c-483a-a70e-77373ca06f10</serial>
Nov 28 13:57:30 user nova-compute[75453]: </disk>
Nov 28 13:57:30 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:57:30 user nova-compute[75453]: INFO nova.compute.claims [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Claim successful on node user
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] No VIF found with MAC fa:16:3e:35:eb:14, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-04f2e529-5110-498c-b684-543e20e894af tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.742s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.800s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.network.neutron [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:57:31 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:57:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.policy [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:57:31 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Creating image(s)
Nov 28 13:57:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "/opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "/opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "/opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.389s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk 1073741824" returned: 0 in 0.060s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG nova.network.neutron [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Successfully created port: f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.261s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:57:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Cannot resize image /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Ensure instance console log exists: /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:33 user nova-compute[75453]: INFO nova.compute.manager [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Detaching volume fd388849-316c-483a-a70e-77373ca06f10
Nov 28 13:57:33 user nova-compute[75453]: INFO nova.virt.block_device [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Attempting to driver detach volume fd388849-316c-483a-a70e-77373ca06f10 from mountpoint /dev/vdb
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Attempting to detach device vdb from instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 13:57:33 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:33 user nova-compute[75453]:   <source dev="/dev/sdj"/>
Nov 28 13:57:33 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:33 user nova-compute[75453]:   <serial>fd388849-316c-483a-a70e-77373ca06f10</serial>
Nov 28 13:57:33 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 13:57:33 user nova-compute[75453]: </disk>
Nov 28 13:57:33 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:57:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Successfully detached device vdb from instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 from the persistent domain config.
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 13:57:33 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:33 user nova-compute[75453]:   <source dev="/dev/sdj"/>
Nov 28 13:57:33 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:33 user nova-compute[75453]:   <serial>fd388849-316c-483a-a70e-77373ca06f10</serial>
Nov 28 13:57:33 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 13:57:33 user nova-compute[75453]: </disk>
Nov 28 13:57:33 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Successfully updated port: f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "refresh_cache-982e2518-5a29-4c35-b9e1-61e7401a4fd0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquired lock "refresh_cache-982e2518-5a29-4c35-b9e1-61e7401a4fd0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received event network-changed-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Refreshing instance network info cache due to event network-changed-f8bff86a-512f-4ff3-97fc-c35d36d68960. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] Acquiring lock "refresh_cache-982e2518-5a29-4c35-b9e1-61e7401a4fd0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:57:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.network.neutron [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Updating instance_info_cache with network_info: [{"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Releasing lock "refresh_cache-982e2518-5a29-4c35-b9e1-61e7401a4fd0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Instance network_info: |[{"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] Acquired lock "refresh_cache-982e2518-5a29-4c35-b9e1-61e7401a4fd0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.network.neutron [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Refreshing network info cache for port f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Start _get_guest_xml network_info=[{"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:57:34 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:57:34 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-303146235',display_name='tempest-AttachVolumeNegativeTest-server-303146235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-303146235',id=13,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZKtitTlaexaynsP4WYOVlVy18YpeWUi10uTrsxp5Ap02gRbOPB7ajo7zQlg7nEQY/n9BSdbr0uf/IC3pIF4N0iY3+Q3kTObIRV7J9kIk52u+nAsjapNr4dUfTwF11g5A==',key_name='tempest-keypair-1167956881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-e5b37nad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=982e2518-5a29-4c35-b9e1-61e7401a4fd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8bff86a-512f-4ff3-97fc-c35d36d68960,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bff86a-51') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.objects.instance [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'pci_devices' on Instance uuid 982e2518-5a29-4c35-b9e1-61e7401a4fd0 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:57:34 user nova-compute[75453]:   <uuid>982e2518-5a29-4c35-b9e1-61e7401a4fd0</uuid>
Nov 28 13:57:34 user nova-compute[75453]:   <name>instance-0000000d</name>
Nov 28 13:57:34 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:57:34 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:57:34 user nova-compute[75453]:   <metadata>
Nov 28 13:57:34 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:57:34 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:57:34 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeNegativeTest-server-303146235</nova:name>
Nov 28 13:57:34 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:57:34</nova:creationTime>
Nov 28 13:57:34 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:57:34 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:57:34 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:57:34 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:57:34 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:57:34 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:57:34 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:57:34 user nova-compute[75453]:       <nova:owner>
Nov 28 13:57:34 user nova-compute[75453]:         <nova:user uuid="2afdefdd832241779d405f4763c3b37e">tempest-AttachVolumeNegativeTest-180653455-project-member</nova:user>
Nov 28 13:57:34 user nova-compute[75453]:         <nova:project uuid="b710669f2d5c41378e2c63765f2846ed">tempest-AttachVolumeNegativeTest-180653455</nova:project>
Nov 28 13:57:34 user nova-compute[75453]:       </nova:owner>
Nov 28 13:57:34 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:57:34 user nova-compute[75453]:       <nova:ports>
Nov 28 13:57:34 user nova-compute[75453]:         <nova:port uuid="f8bff86a-512f-4ff3-97fc-c35d36d68960">
Nov 28 13:57:34 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 13:57:34 user nova-compute[75453]:         </nova:port>
Nov 28 13:57:34 user nova-compute[75453]:       </nova:ports>
Nov 28 13:57:34 user nova-compute[75453]:     </nova:instance>
Nov 28 13:57:34 user nova-compute[75453]:   </metadata>
Nov 28 13:57:34 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:57:34 user nova-compute[75453]:     <system>
Nov 28 13:57:34 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:57:34 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:57:34 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:57:34 user nova-compute[75453]:       <entry name="serial">982e2518-5a29-4c35-b9e1-61e7401a4fd0</entry>
Nov 28 13:57:34 user nova-compute[75453]:       <entry name="uuid">982e2518-5a29-4c35-b9e1-61e7401a4fd0</entry>
Nov 28 13:57:34 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:57:34 user nova-compute[75453]:     </system>
Nov 28 13:57:34 user nova-compute[75453]:   </sysinfo>
Nov 28 13:57:34 user nova-compute[75453]:   <os>
Nov 28 13:57:34 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:57:34 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:57:34 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:57:34 user nova-compute[75453]:   </os>
Nov 28 13:57:34 user nova-compute[75453]:   <features>
Nov 28 13:57:34 user nova-compute[75453]:     <acpi/>
Nov 28 13:57:34 user nova-compute[75453]:     <apic/>
Nov 28 13:57:34 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:57:34 user nova-compute[75453]:   </features>
Nov 28 13:57:34 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:57:34 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:57:34 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:57:34 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:57:34 user nova-compute[75453]:   </clock>
Nov 28 13:57:34 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:57:34 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:57:34 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:57:34 user nova-compute[75453]:   </cpu>
Nov 28 13:57:34 user nova-compute[75453]:   <devices>
Nov 28 13:57:34 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:57:34 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:57:34 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk"/>
Nov 28 13:57:34 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:57:34 user nova-compute[75453]:     </disk>
Nov 28 13:57:34 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:57:34 user nova-compute[75453]:       <mac address="fa:16:3e:fd:30:cb"/>
Nov 28 13:57:34 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:57:34 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:57:34 user nova-compute[75453]:       <target dev="tapf8bff86a-51"/>
Nov 28 13:57:34 user nova-compute[75453]:     </interface>
Nov 28 13:57:34 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:57:34 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/console.log" append="off"/>
Nov 28 13:57:34 user nova-compute[75453]:     </serial>
Nov 28 13:57:34 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:57:34 user nova-compute[75453]:     <video>
Nov 28 13:57:34 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:57:34 user nova-compute[75453]:     </video>
Nov 28 13:57:34 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:57:34 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:57:34 user nova-compute[75453]:     </rng>
Nov 28 13:57:34 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:57:34 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:57:34 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:57:34 user nova-compute[75453]:     </memballoon>
Nov 28 13:57:34 user nova-compute[75453]:   </devices>
Nov 28 13:57:34 user nova-compute[75453]: </domain>
Nov 28 13:57:34 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-303146235',display_name='tempest-AttachVolumeNegativeTest-server-303146235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-303146235',id=13,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZKtitTlaexaynsP4WYOVlVy18YpeWUi10uTrsxp5Ap02gRbOPB7ajo7zQlg7nEQY/n9BSdbr0uf/IC3pIF4N0iY3+Q3kTObIRV7J9kIk52u+nAsjapNr4dUfTwF11g5A==',key_name='tempest-keypair-1167956881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-e5b37nad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=982e2518-5a29-4c35-b9e1-61e7401a4fd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8bff86a-512f-4ff3-97fc-c35d36d68960,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bff86a-51') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG os_vif [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8bff86a-512f-4ff3-97fc-c35d36d68960,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bff86a-51') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bd7c2d2-ad7a-5ccb-a209-5e409e2d1f28', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8bff86a-51, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8bff86a-51, col_values=(('qos', UUID('a7983b16-5fca-4380-b172-bfa8939c34c9')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8bff86a-51, col_values=(('external_ids', {'iface-id': 'f8bff86a-512f-4ff3-97fc-c35d36d68960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:30:cb', 'vm-uuid': '982e2518-5a29-4c35-b9e1-61e7401a4fd0'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:34 user nova-compute[75453]: INFO os_vif [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8bff86a-512f-4ff3-97fc-c35d36d68960,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bff86a-51')
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No VIF found with MAC fa:16:3e:fd:30:cb, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.network.neutron [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Updated VIF entry in instance network info cache for port f8bff86a-512f-4ff3-97fc-c35d36d68960. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG nova.network.neutron [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Updating instance_info_cache with network_info: [{"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a289954-170f-4a88-aaa6-e1941e0f61d8 req-5c0acbd3-d492-41a2-bb78-7d98265429f2 service nova] Releasing lock "refresh_cache-982e2518-5a29-4c35-b9e1-61e7401a4fd0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-changed-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Refreshing instance network info cache due to event network-changed-885d9ccd-4b72-4063-b89a-ae6a3466a743. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] Acquiring lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] Acquired lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Refreshing network info cache for port 885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "interface-a9a21b61-5815-47ed-adac-040b1fc8e33a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "interface-a9a21b61-5815-47ed-adac-040b1fc8e33a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lazy-loading 'flavor' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updated VIF entry in instance network info cache for port 885d9ccd-4b72-4063-b89a-ae6a3466a743. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updating instance_info_cache with network_info: [{"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e1a65253-c457-4bdc-a72f-9c6f4a88910d req-9d6e316c-f989-4df9-95df-304efab10368 service nova] Releasing lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG nova.objects.instance [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lazy-loading 'pci_requests' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG nova.objects.base [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Object Instance<a9a21b61-5815-47ed-adac-040b1fc8e33a> lazy-loaded attributes: flavor,pci_requests {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lazy-loading 'flavor' on Instance uuid 66c010a7-3604-41c4-9599-d41172a28fe2 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received event network-vif-plugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] Acquiring lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] No waiting events found dispatching network-vif-plugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:36 user nova-compute[75453]: WARNING nova.compute.manager [req-e8166cc3-42d6-4638-99f5-83c3c0b115d6 req-1d1a9b1d-13d0-4302-a690-d64d2eaa52dd service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received unexpected event network-vif-plugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance with vm_state building and task_state spawning.
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG nova.policy [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c126fcfb0e4747ccaaf814d508698c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb964406b0844ce997488844a2b0676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:36 user nova-compute[75453]: INFO nova.compute.manager [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Attaching volume 2590ffd1-7637-4a90-ad5d-4209148c61a7 to /dev/vdb
Nov 28 13:57:36 user nova-compute[75453]: DEBUG os_brick.utils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed87b20-4b71-4df6-8930-1b2e7fe82437]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3246b613-69fc-462d-a75b-d96dface6c84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf01129-5cbc-4a6c-b5eb-0cf3f123aa4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[716e2bc8-da02-4fd7-83fd-c7b66737c2db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:36 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:57:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a547292-3d3d-4626-b14b-28e318be1fd3]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG os_brick.utils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:36 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Updating existing volume attachment record: 9de44a18-4dbd-4fd0-bfdf-fb08560c5143 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG nova.compute.manager [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received event network-changed-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG nova.compute.manager [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Refreshing instance network info cache due to event network-changed-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] Acquiring lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] Acquired lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG nova.network.neutron [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Refreshing network info cache for port 1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Successfully created port: 90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG nova.network.neutron [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Updated VIF entry in instance network info cache for port 1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG nova.network.neutron [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Updating instance_info_cache with network_info: [{"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bb3eacf4-b698-4108-9d53-6c908bf88691 req-f0ab8813-4165-465c-9b1d-9e42260fb13a service nova] Releasing lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Successfully updated port: 90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquired lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:37 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:57:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Instance spawned successfully.
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:57:38 user nova-compute[75453]: INFO nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received event network-vif-plugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Acquiring lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] No waiting events found dispatching network-vif-plugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:38 user nova-compute[75453]: WARNING nova.compute.manager [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received unexpected event network-vif-plugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance with vm_state building and task_state spawning.
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-changed-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Refreshing instance network info cache due to event network-changed-90a8cdca-86d8-40cc-990f-6a68ae35bd69. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Acquiring lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:38 user nova-compute[75453]: INFO nova.compute.manager [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Took 7.79 seconds to build instance.
Nov 28 13:57:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-367014c2-f2d5-4e8b-8b24-08868b7098b0 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.919s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.network.neutron [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updating instance_info_cache with network_info: [{"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Releasing lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Acquired lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.network.neutron [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Refreshing network info cache for port 90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535040327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535040327',id=6,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ==',key_name='tempest-keypair-1885537121',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0eb964406b0844ce997488844a2b0676',ramdisk_id='',reservation_id='r-nhd1qkbi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487095452',owner_user_name='tempest-TaggedAttachmentsTest-1487095452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c126fcfb0e4747ccaaf814d508698c55',uuid=a9a21b61-5815-47ed-adac-040b1fc8e33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converting VIF {"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG os_vif [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5f98cb0-dcfd-5655-a7ef-4f6ab7b90e5b', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90a8cdca-86, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90a8cdca-86, col_values=(('qos', UUID('502338de-54ea-4a3c-a51f-994db918d298')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90a8cdca-86, col_values=(('external_ids', {'iface-id': '90a8cdca-86d8-40cc-990f-6a68ae35bd69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:5d:3e', 'vm-uuid': 'a9a21b61-5815-47ed-adac-040b1fc8e33a'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: INFO os_vif [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86')
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535040327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535040327',id=6,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ==',key_name='tempest-keypair-1885537121',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0eb964406b0844ce997488844a2b0676',ramdisk_id='',reservation_id='r-nhd1qkbi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487095452',owner_user_name='tempest-TaggedAttachmentsTest-1487095452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c126fcfb0e4747ccaaf814d508698c55',uuid=a9a21b61-5815-47ed-adac-040b1fc8e33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converting VIF {"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] attach device xml: <interface type="ethernet">
Nov 28 13:57:38 user nova-compute[75453]:   <mac address="fa:16:3e:78:5d:3e"/>
Nov 28 13:57:38 user nova-compute[75453]:   <model type="virtio"/>
Nov 28 13:57:38 user nova-compute[75453]:   <mtu size="1442"/>
Nov 28 13:57:38 user nova-compute[75453]:   <target dev="tap90a8cdca-86"/>
Nov 28 13:57:38 user nova-compute[75453]: </interface>
Nov 28 13:57:38 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] No BDM found with device name hda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] No VIF found with MAC fa:16:3e:c2:b7:b3, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG nova.network.neutron [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updated VIF entry in instance network info cache for port 90a8cdca-86d8-40cc-990f-6a68ae35bd69. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG nova.network.neutron [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updating instance_info_cache with network_info: [{"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:57:39 user nova-compute[75453]:   <nova:package version="0.0.0"/>
Nov 28 13:57:39 user nova-compute[75453]:   <nova:name>tempest-device-tagging-server-535040327</nova:name>
Nov 28 13:57:39 user nova-compute[75453]:   <nova:creationTime>2023-11-28 13:57:39</nova:creationTime>
Nov 28 13:57:39 user nova-compute[75453]:   <nova:flavor name="m1.tiny">
Nov 28 13:57:39 user nova-compute[75453]:     <nova:memory>512</nova:memory>
Nov 28 13:57:39 user nova-compute[75453]:     <nova:disk>1</nova:disk>
Nov 28 13:57:39 user nova-compute[75453]:     <nova:swap>0</nova:swap>
Nov 28 13:57:39 user nova-compute[75453]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:57:39 user nova-compute[75453]:     <nova:vcpus>1</nova:vcpus>
Nov 28 13:57:39 user nova-compute[75453]:   </nova:flavor>
Nov 28 13:57:39 user nova-compute[75453]:   <nova:owner>
Nov 28 13:57:39 user nova-compute[75453]:     <nova:user uuid="c126fcfb0e4747ccaaf814d508698c55">tempest-TaggedAttachmentsTest-1487095452-project-member</nova:user>
Nov 28 13:57:39 user nova-compute[75453]:     <nova:project uuid="0eb964406b0844ce997488844a2b0676">tempest-TaggedAttachmentsTest-1487095452</nova:project>
Nov 28 13:57:39 user nova-compute[75453]:   </nova:owner>
Nov 28 13:57:39 user nova-compute[75453]:   <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:57:39 user nova-compute[75453]:   <nova:ports>
Nov 28 13:57:39 user nova-compute[75453]:     <nova:port uuid="885d9ccd-4b72-4063-b89a-ae6a3466a743">
Nov 28 13:57:39 user nova-compute[75453]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 13:57:39 user nova-compute[75453]:     </nova:port>
Nov 28 13:57:39 user nova-compute[75453]:     <nova:port uuid="90a8cdca-86d8-40cc-990f-6a68ae35bd69">
Nov 28 13:57:39 user nova-compute[75453]:       <nova:ip type="fixed" address="10.10.10.37" ipVersion="4"/>
Nov 28 13:57:39 user nova-compute[75453]:     </nova:port>
Nov 28 13:57:39 user nova-compute[75453]:   </nova:ports>
Nov 28 13:57:39 user nova-compute[75453]: </nova:instance>
Nov 28 13:57:39 user nova-compute[75453]:  {{(pid=75453) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-plugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] No waiting events found dispatching network-vif-plugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:39 user nova-compute[75453]: WARNING nova.compute.manager [req-2d529600-09b7-426a-985b-06304b8a337e req-6550f61b-6738-42f9-8b1c-9cb9651a89bd service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received unexpected event network-vif-plugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance with vm_state active and task_state None.
Nov 28 13:57:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f70dffb2-77e1-4e92-8756-9ec8f07ee80e req-fd8c2b95-80de-4053-b1eb-f60106c9f9a3 service nova] Releasing lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40017d8f-f35d-4609-897f-2b32c4fa7bf9 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "interface-a9a21b61-5815-47ed-adac-040b1fc8e33a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.711s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG nova.objects.instance [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lazy-loading 'flavor' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:40 user nova-compute[75453]: INFO nova.compute.manager [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Attaching volume 6ee43782-0ea5-4236-bcb9-ea574a51fd6f to /dev/vdb
Nov 28 13:57:40 user nova-compute[75453]: DEBUG os_brick.utils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e60fee8-2c6e-4c21-92cf-7a1067ace6b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc122d0d-c6da-42a1-955d-ef91ecb03944]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f66ffd-7b26-4d2d-8b56-7b57bbcc147c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[86073bab-9318-4d04-8b7d-e565dc950ee4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:40 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:57:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd167ce-abd5-4c32-8d6b-6ab9e0e64acc]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG os_brick.utils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:40 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updating existing volume attachment record: bf90dce4-dc63-47cd-a639-f9d35f90371b {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:57:41 user nova-compute[75453]: DEBUG nova.compute.manager [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-plugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:41 user nova-compute[75453]: DEBUG nova.compute.manager [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] No waiting events found dispatching network-vif-plugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:57:41 user nova-compute[75453]: WARNING nova.compute.manager [req-ae0ba127-b5fa-47e1-8abe-0c3f6600381f req-20ccb9be-08a0-4500-8231-b1524b32eb09 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received unexpected event network-vif-plugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance with vm_state active and task_state None.
Nov 28 13:57:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received event network-changed-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Refreshing instance network info cache due to event network-changed-0b01647b-3ee6-4152-adac-c584772d441a. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] Acquiring lock "refresh_cache-57dc143b-7f7a-46e4-85c2-bed1c455b92d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] Acquired lock "refresh_cache-57dc143b-7f7a-46e4-85c2-bed1c455b92d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Refreshing network info cache for port 0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lazy-loading 'flavor' on Instance uuid 57dc143b-7f7a-46e4-85c2-bed1c455b92d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:45 user nova-compute[75453]: INFO nova.compute.manager [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Attaching volume c256684c-2c3b-4052-8a85-942271fc83a0 to /dev/vdb
Nov 28 13:57:45 user nova-compute[75453]: DEBUG os_brick.utils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Updated VIF entry in instance network info cache for port 0b01647b-3ee6-4152-adac-c584772d441a. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Updating instance_info_cache with network_info: [{"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c2830-f599-45db-aca3-4a45d522c81b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-926fe0a9-d87f-408e-b665-fc7106ddfe82 req-e8c17806-d308-44ac-9335-bc75c42537ea service nova] Releasing lock "refresh_cache-57dc143b-7f7a-46e4-85c2-bed1c455b92d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70c9155-a7bc-43a0-8169-3313792e9cff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8651ce98-1dfb-4f0b-a67a-51890b823412]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808efb3-2707-48bc-be3d-e3ab9198fca5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:45 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:57:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[895eedca-ce0f-4147-acaf-9ebb4ed9a949]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG os_brick.utils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:45 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Updating existing volume attachment record: c8734a64-1d2b-42ee-89ab-691a7359dc6d {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:57:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWFeqNjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:48 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:48 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:48 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd88026c-43b5-4edb-a723-82c04aa7a8de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:57:48 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e723c19c-4cab-4857-940a-ced08373f12b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f] added
Nov 28 13:57:48 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc379f7-ef76-4f6b-b8c8-95f355a25267]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c58cda-e22c-4596-b366-2444abe5d318]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cWFeqNjP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cWFeqNjP" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[890822c1-8d86-4ab1-a376-324d3e35b98c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cWFeqNjP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[826746e3-e983-441b-bfd5-abd02e13bb25]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ef05ef-d563-4437-a710-e16dbeb1abd9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:48 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[79025eaa-0fec-4570-bb98-a3be2ff300d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f, portal: 172.16.0.220,3260]
Nov 28 13:57:48 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f, portal: 172.16.0.220,3260] successful.
Nov 28 13:57:48 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[579f3ac0-145d-4f8b-8c19-5205da54dad1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4784df19-3986-4c82-b84f-972e9d612522]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[593732f4-988c-45fe-97d9-c597f4c401b1]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:57:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWFeqNjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:57:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23335623537373331', 'path': '/dev/sdk'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335623537373331', 'path': '/dev/sdk'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:57:50 user nova-compute[75453]: DEBUG nova.objects.instance [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lazy-loading 'flavor' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 13:57:50 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:50 user nova-compute[75453]:   <source dev="/dev/sdk"/>
Nov 28 13:57:50 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:50 user nova-compute[75453]:   <serial>6ee43782-0ea5-4236-bcb9-ea574a51fd6f</serial>
Nov 28 13:57:50 user nova-compute[75453]: </disk>
Nov 28 13:57:50 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 13:57:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] No BDM found with device name hda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] No VIF found with MAC fa:16:3e:c2:b7:b3, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:57:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29215a55-f4ac-403d-856c-6a8f5d6fab1e tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.671s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:51 user nova-compute[75453]: INFO nova.compute.manager [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Detaching volume 6ee43782-0ea5-4236-bcb9-ea574a51fd6f
Nov 28 13:57:51 user nova-compute[75453]: INFO nova.virt.block_device [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Attempting to driver detach volume 6ee43782-0ea5-4236-bcb9-ea574a51fd6f from mountpoint /dev/vdb
Nov 28 13:57:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Attempting to detach device vdb from instance a9a21b61-5815-47ed-adac-040b1fc8e33a from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 13:57:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 13:57:52 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:52 user nova-compute[75453]:   <source dev="/dev/sdk"/>
Nov 28 13:57:52 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:52 user nova-compute[75453]:   <serial>6ee43782-0ea5-4236-bcb9-ea574a51fd6f</serial>
Nov 28 13:57:52 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 13:57:52 user nova-compute[75453]: </disk>
Nov 28 13:57:52 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:57:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Successfully detached device vdb from instance a9a21b61-5815-47ed-adac-040b1fc8e33a from the persistent domain config.
Nov 28 13:57:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9a21b61-5815-47ed-adac-040b1fc8e33a from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 13:57:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 13:57:52 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:52 user nova-compute[75453]:   <source dev="/dev/sdk"/>
Nov 28 13:57:52 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:52 user nova-compute[75453]:   <serial>6ee43782-0ea5-4236-bcb9-ea574a51fd6f</serial>
Nov 28 13:57:52 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 13:57:52 user nova-compute[75453]: </disk>
Nov 28 13:57:52 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:57:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 is timed out.
Nov 28 13:57:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Successfully detached device vdb from instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 from the live domain config.
Nov 28 13:57:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvJknzKs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:53 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[806ae3cd-5a85-4bcd-b5fb-c2d63598bc69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:57:53 user nova-compute[75453]: No targets found.
Nov 28 13:57:53 user nova-compute[75453]: iSNS:
Nov 28 13:57:53 user nova-compute[75453]: No targets found.
Nov 28 13:57:53 user nova-compute[75453]: STATIC:
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324
Nov 28 13:57:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:57:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:57:53 user nova-compute[75453]: FIRMWARE:
Nov 28 13:57:53 user nova-compute[75453]: No targets found.
Nov 28 13:57:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:57:53 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:57:53 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:57:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dee128-a2ed-43c2-95b8-5bc9e1d8576d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf592531-3d92-4272-a063-2eb5a1244f5d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c54df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10'): ({'sdj'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Removing single pathed devices sdj {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d2e546-e30f-4741-bef1-b9a94feea184]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[32feae12-1373-42a3-9ffa-cbc548b9ad98]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Flushing IO for device /dev/sdj {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwQCvUtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:54 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d617181d-c3ce-4a69-8141-a476e240aa74]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.044s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[450db714-563e-4c01-8c63-946dc6fe174f]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] SCSI volumes sdj have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45fba81-d83c-4f1c-bda7-db0446e85cf8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhAUwWeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:54 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e4eb18-64db-4f68-89b7-8cfd30e7a18f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10, portal: 172.16.0.220,3260]
Nov 28 13:57:54 user nova-compute[75453]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10, portal: 172.16.0.220,3260] successful.
Nov 28 13:57:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd388849-316c-483a-a70e-77373ca06f10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9a58b7-790d-4bf5-a11b-ebc2da3d5d9b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] <== disconnect_volume: return (398ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.217s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:54 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:54 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52b37f9-4e93-4fd0-8be8-bc19a4dbf718]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:57:54 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dabdd6-12a1-4267-9220-9aab56e2b1fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7] added
Nov 28 13:57:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[879baa00-4130-4c0c-bae0-5c9dd742e6bd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36f234b-e082-47f2-a251-4d3ed3407b94]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwQCvUtA {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwQCvUtA" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03873c1-ddf6-4de8-b320-adf3c89e21d0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwQCvUtA'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e3ce4d-3453-42e6-8d4d-d2aaf6c0aef4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d948de33-1724-479f-96ad-952acf9d945b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9003064e-891c-46b3-85f6-57d1e295a9c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7, portal: 172.16.0.220,3260]
Nov 28 13:57:54 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7, portal: 172.16.0.220,3260] successful.
Nov 28 13:57:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cd6d08-2f3c-42f0-b091-e611fadf6127]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f44da46-ee36-4d72-937b-7656c439e652]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[32df9c49-9f8b-48d5-a6e7-b3f90a507dfe]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:57:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwQCvUtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lazy-loading 'flavor' on Instance uuid 3907babd-71af-4fca-8ad7-4a7dae1710d6 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d4288681-086c-4b54-a6f1-f4a1ac2f029a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.957s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] <== connect_volume: return (1628ms) {'type': 'block', 'scsi_wwn': '23936363631336133', 'path': '/dev/sdj'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936363631336133', 'path': '/dev/sdj'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.534s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:55 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:57:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:57:55 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lazy-loading 'flavor' on Instance uuid 66c010a7-3604-41c4-9599-d41172a28fe2 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0bc748-43da-48ed-9848-4ac5fe598c80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:57:55 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 13:57:55 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:55 user nova-compute[75453]:   <source dev="/dev/sdj"/>
Nov 28 13:57:55 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:55 user nova-compute[75453]:   <serial>2590ffd1-7637-4a90-ad5d-4209148c61a7</serial>
Nov 28 13:57:55 user nova-compute[75453]: </disk>
Nov 28 13:57:55 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff419973-1ca5-4ff4-a47b-a0bb00cfa333]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0] added
Nov 28 13:57:55 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0203d5-d2b1-4110-9d71-4b763da01e80]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.122s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[163eacff-7275-45f0-b8da-a589f24b3604]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhAUwWeO {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhAUwWeO" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc1811f-549a-48b6-90a7-59a17834a444]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rhAUwWeO'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3657fc2-46a2-455e-a90c-dd54bb3cc619]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6003239-fd46-4a08-9641-158b5a067646]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.133s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[374eae36-b668-41e2-ba5d-898177457541]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0, portal: 172.16.0.220,3260]
Nov 28 13:57:56 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0, portal: 172.16.0.220,3260] successful.
Nov 28 13:57:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.134s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dde036-571f-41bc-8602-9e744a6544da]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[64babf4c-0e2e-4ff5-aac7-93bccc475f66]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:57:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.641s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b68d361-12ec-45b7-95b7-03ca88273957]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhAUwWeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] No VIF found with MAC fa:16:3e:97:64:75, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c53b078d-2fc7-46e9-8a3f-646db18d5159 tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.166s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.689s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:57:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] <== connect_volume: return (3223ms) {'type': 'block', 'scsi_wwn': '23266353162323463', 'path': '/dev/sdl'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266353162323463', 'path': '/dev/sdl'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:57:57 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lazy-loading 'flavor' on Instance uuid 57dc143b-7f7a-46e4-85c2-bed1c455b92d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] attach device xml: <disk type="block" device="disk">
Nov 28 13:57:57 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:57 user nova-compute[75453]:   <source dev="/dev/sdl"/>
Nov 28 13:57:57 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:57 user nova-compute[75453]:   <serial>c256684c-2c3b-4052-8a85-942271fc83a0</serial>
Nov 28 13:57:57 user nova-compute[75453]: </disk>
Nov 28 13:57:57 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 13:57:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:57:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] No VIF found with MAC fa:16:3e:b1:8f:02, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG os_brick.utils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[606b2246-2833-452a-9fca-9505547eb87b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d06892ed-6848-498c-9eaf-9f3b763ec7f6 tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.417s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2747593e-051e-42dc-a074-eb12cc415ab5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ff14f4-e15a-456f-beb2-32c542b6cb51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e766a4f-0627-4619-b228-984bb054c84a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:57:58 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:57:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11b9dff-67c0-48f6-a973-f16c08b2b4eb]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG os_brick.utils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:57:58 user nova-compute[75453]: INFO nova.compute.manager [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Swapping volume 2590ffd1-7637-4a90-ad5d-4209148c61a7 for f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:57:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] volume_snapshot_create: create_info: {'snapshot_id': 'df4520e7-d77e-4cfd-952e-b7f33f568c89', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75453) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] snap xml: <domainsnapshot>
Nov 28 13:57:58 user nova-compute[75453]:   <disks>
Nov 28 13:57:58 user nova-compute[75453]:     <disk name="/dev/sdl" snapshot="external" type="file">
Nov 28 13:57:58 user nova-compute[75453]:       <source file="/dev/new_file"/>
Nov 28 13:57:58 user nova-compute[75453]:     </disk>
Nov 28 13:57:58 user nova-compute[75453]:     <disk name="vda" snapshot="no"/>
Nov 28 13:57:58 user nova-compute[75453]:   </disks>
Nov 28 13:57:58 user nova-compute[75453]: </domainsnapshot>
Nov 28 13:57:58 user nova-compute[75453]:  {{(pid=75453) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 28 13:57:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Lazy-loading 'system_metadata' on Instance uuid 57dc143b-7f7a-46e4-85c2-bed1c455b92d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:57:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     rv = execute(f, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     six.reraise(c, e, tb)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     raise value
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     rv = meth(*args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     self._volume_snapshot_create(context, instance, guest,
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     rv = execute(f, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     six.reraise(c, e, tb)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     raise value
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     rv = meth(*args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] 
Nov 28 13:57:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] volume_snapshot_delete: delete_info: {'volume_id': 'c256684c-2c3b-4052-8a85-942271fc83a0'} {{(pid=75453) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d]     if delete_info['type'] != 'qcow2':
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] KeyError: 'type'
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot df4520e7-d77e-4cfd-952e-b7f33f568c89 could not be found.
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     raise value
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot df4520e7-d77e-4cfd-952e-b7f33f568c89 could not be found. (HTTP 404) (Request-ID: req-ebfa2dc2-8487-4b3b-81ed-154a91d953aa)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot df4520e7-d77e-4cfd-952e-b7f33f568c89 could not be found.
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server [None req-c4810ddb-61ac-4e3a-a987-0c05972d99a6 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise value
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-5fab0c6e-e79b-4699-b1d2-6f782f18f6cd)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 13:57:59 user nova-compute[75453]: ERROR nova.virt.libvirt.driver 
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server [None req-ced4c42d-27ac-4d6b-86e1-0b75c2916bf5 tempest-VolumesAssistedSnapshotsTest-1674713485 tempest-VolumesAssistedSnapshotsTest-1674713485-project] Exception during message handling: KeyError: 'type'
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 28 13:57:59 user nova-compute[75453]: ERROR oslo_messaging.rpc.server 
Nov 28 13:57:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:57:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:57:59 user nova-compute[75453]: INFO nova.compute.manager [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Detaching volume c256684c-2c3b-4052-8a85-942271fc83a0
Nov 28 13:57:59 user nova-compute[75453]: INFO nova.virt.block_device [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Attempting to driver detach volume c256684c-2c3b-4052-8a85-942271fc83a0 from mountpoint /dev/vdb
Nov 28 13:57:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Attempting to detach device vdb from instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 13:57:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 13:57:59 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:59 user nova-compute[75453]:   <source dev="/dev/sdl"/>
Nov 28 13:57:59 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:59 user nova-compute[75453]:   <serial>c256684c-2c3b-4052-8a85-942271fc83a0</serial>
Nov 28 13:57:59 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 13:57:59 user nova-compute[75453]: </disk>
Nov 28 13:57:59 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:57:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Successfully detached device vdb from instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d from the persistent domain config.
Nov 28 13:57:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 13:57:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 13:57:59 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:57:59 user nova-compute[75453]:   <source dev="/dev/sdl"/>
Nov 28 13:57:59 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:57:59 user nova-compute[75453]:   <serial>c256684c-2c3b-4052-8a85-942271fc83a0</serial>
Nov 28 13:57:59 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 13:57:59 user nova-compute[75453]: </disk>
Nov 28 13:57:59 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:57:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:57:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 13:58:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:58:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:01 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 13:58:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:58:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7032MB free_disk=25.43722152709961GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMZbITkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66c010a7-3604-41c4-9599-d41172a28fe2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4e3b65a-e2e0-4261-8f67-f4b561ad120c', 'serial': 'f4e3b65a-e2e0-4261-8f67-f4b561ad120c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwQCvUtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '66c010a7-3604-41c4-9599-d41172a28fe2', 'attached_at': '', 'detached_at': '', 'volume_id': '2590ffd1-7637-4a90-ad5d-4209148c61a7', 'serial'} {{(pid=75453) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMZbITkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:06 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:06 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:06 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-changed-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing instance network info cache due to event network-changed-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] Acquiring lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] Acquired lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Refreshing network info cache for port 2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260" returned: 21 in 0.045s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6821b1-812f-4016-9f28-1b47c0b16e43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:58:06 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e29114a-37dc-4674-bc36-091f5077fed3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c] added
Nov 28 13:58:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c1e34e-91c4-4ffd-95a9-10ee948709c6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1d87ca-9674-4498-beb6-99bc066858e0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 48dd0221-4935-4ee2-9958-90a748fe5255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 949a3612-5042-420f-9911-ec641017d399 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance a9a21b61-5815-47ed-adac-040b1fc8e33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 66c010a7-3604-41c4-9599-d41172a28fe2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 794937d9-3c23-41cf-bb74-767e93bc1370 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 21bca975-80ab-4d17-8a2d-9435c5f9646f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eMZbITkS {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eMZbITkS" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00a07e-a0ff-4636-9ab8-79884815135c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eMZbITkS'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a372a7b-9074-449e-9df3-d91a773cac11]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a02a004-87aa-414b-8499-8b0098cce154]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1eb25a-ee23-401c-8573-51c7aacb0b0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c, portal: 172.16.0.220,3260]
Nov 28 13:58:06 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c, portal: 172.16.0.220,3260] successful.
Nov 28 13:58:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a898e6-01ec-4fd4-a5af-e0390662a851]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5eefbb-0007-4326-acb8-fe6111f7c123]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] HCTL ('44', '-', '-', 0) found on session 14 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:58:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[88816af4-6933-4190-bc2d-2c313caecb71]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMZbITkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG nova.network.neutron [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updated VIF entry in instance network info cache for port 2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG nova.network.neutron [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [{"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.755s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-98b7c78a-3369-400c-bb56-fa916e776c14 req-9704dc94-7664-41d1-9e8f-05aa5efd54aa service nova] Releasing lock "refresh_cache-31d8d6df-6235-4a05-a03b-b6d67c3698b2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] <== connect_volume: return (1518ms) {'type': 'block', 'scsi_wwn': '26332613235336266', 'path': '/dev/sdm'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332613235336266', 'path': '/dev/sdm'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lazy-loading 'flavor' on Instance uuid 66c010a7-3604-41c4-9599-d41172a28fe2 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Checking UEFI support for host arch (x86_64) {{(pid=75453) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 28 13:58:08 user nova-compute[75453]: INFO nova.virt.libvirt.host [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] UEFI support detected
Nov 28 13:58:08 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 156237824 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance_info_cache with network_info: [{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:09 user nova-compute[75453]: INFO nova.compute.manager [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Terminating instance
Nov 28 13:58:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 282066944 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-unplugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-d51d23eb-3732-493e-9313-87d877b22ac5 req-efb12295-8f2a-4b89-89f8-87edcd1dd142 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 418381824 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-unplugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-879780ad-758f-4981-86fb-0aa51678b641 req-557bbbd0-3693-4293-b684-37bcdbfe4e4c service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 535822336 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 687865856 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Instance destroyed successfully.
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.objects.instance [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lazy-loading 'resources' on Instance uuid 31d8d6df-6235-4a05-a03b-b6d67c3698b2 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:ec:37,bridge_name='br-int',has_traffic_filtering=True,id=2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8,network=Network(bbcbef15-20ec-4dd4-adb4-47914fd7aba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2348a0-f2') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:ec:37,bridge_name='br-int',has_traffic_filtering=True,id=2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8,network=Network(bbcbef15-20ec-4dd4-adb4-47914fd7aba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2348a0-f2') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d2348a0-f2, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86cdc619-c099-4870-8f24-97784170f0e6) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 839909376 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:11 user nova-compute[75453]: INFO os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:ec:37,bridge_name='br-int',has_traffic_filtering=True,id=2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8,network=Network(bbcbef15-20ec-4dd4-adb4-47914fd7aba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2348a0-f2')
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:9d,bridge_name='br-int',has_traffic_filtering=True,id=96485176-c454-4c24-bbe8-2cf688a69119,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96485176-c4') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:9d,bridge_name='br-int',has_traffic_filtering=True,id=96485176-c454-4c24-bbe8-2cf688a69119,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96485176-c4') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96485176-c4, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd28af06-64ba-4ea9-864e-7f12848f70b0) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: INFO os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:9d,bridge_name='br-int',has_traffic_filtering=True,id=96485176-c454-4c24-bbe8-2cf688a69119,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96485176-c4')
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5872e8ad-8a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5872e8ad-8a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:11 user nova-compute[75453]: WARNING nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 for instance with vm_state active and task_state deleting.
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-unplugged-96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-96485176-c454-4c24-bbe8-2cf688a69119 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-96485176-c454-4c24-bbe8-2cf688a69119 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:11 user nova-compute[75453]: WARNING nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-96485176-c454-4c24-bbe8-2cf688a69119 for instance with vm_state active and task_state deleting.
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-unplugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:11 user nova-compute[75453]: WARNING nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1 for instance with vm_state active and task_state deleting.
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-unplugged-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-c34e615b-e133-4780-8a90-ca0fb5262dfe for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:11 user nova-compute[75453]: WARNING nova.compute.manager [req-0ddf4e10-3edb-4966-b93b-39b78962fc39 req-b6956009-b23f-4937-8332-3cb8e5ab2fd0 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-c34e615b-e133-4780-8a90-ca0fb5262dfe for instance with vm_state active and task_state deleting.
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5872e8ad-8a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89ef72c9-8d77-4b4e-bdbe-f63de0c95484) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: INFO os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:40:1e,bridge_name='br-int',has_traffic_filtering=True,id=5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5872e8ad-8a')
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:1e:c6,bridge_name='br-int',has_traffic_filtering=True,id=c34e615b-e133-4780-8a90-ca0fb5262dfe,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34e615b-e1') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:1e:c6,bridge_name='br-int',has_traffic_filtering=True,id=c34e615b-e133-4780-8a90-ca0fb5262dfe,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34e615b-e1') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc34e615b-e1, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0997b49-ea28-44dc-91be-f7c075170648) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 957349888 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: INFO os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:1e:c6,bridge_name='br-int',has_traffic_filtering=True,id=c34e615b-e133-4780-8a90-ca0fb5262dfe,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34e615b-e1')
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "address": "fa:16:3e:d1:e2:df", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fc3793-a8", "ovs_interfaceid": "03fc3793-a8b8-456b-a80f-c9c5d6925c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e2:df,bridge_name='br-int',has_traffic_filtering=True,id=03fc3793-a8b8-456b-a80f-c9c5d6925c0b,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fc3793-a8') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e2:df,bridge_name='br-int',has_traffic_filtering=True,id=03fc3793-a8b8-456b-a80f-c9c5d6925c0b,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fc3793-a8') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03fc3793-a8, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f63d5348-7485-470a-9887-59b440f442e4) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: INFO os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:e2:df,bridge_name='br-int',has_traffic_filtering=True,id=03fc3793-a8b8-456b-a80f-c9c5d6925c0b,network=Network(df5a3e5f-e2d5-416e-970f-b859d4c1f0fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fc3793-a8')
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=cf289519-83a0-4374-b2e5-757e5e7248f1,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf289519-83') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=cf289519-83a0-4374-b2e5-757e5e7248f1,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf289519-83') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf289519-83, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=479fb2d7-1da5-4d85-8594-573c3ad90f86) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:12 user nova-compute[75453]: WARNING nova.compute.manager [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-03fc3793-a8b8-456b-a80f-c9c5d6925c0b for instance with vm_state active and task_state deleting.
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-unplugged-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-cf289519-83a0-4374-b2e5-757e5e7248f1 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:12 user nova-compute[75453]: WARNING nova.compute.manager [req-d9c9e8fe-6072-467e-b35a-f65300d4bda9 req-7301a582-fdef-425a-b814-37ffc6b79adb service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-cf289519-83a0-4374-b2e5-757e5e7248f1 for instance with vm_state active and task_state deleting.
Nov 28 13:58:12 user nova-compute[75453]: INFO os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=cf289519-83a0-4374-b2e5-757e5e7248f1,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf289519-83')
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-593415065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-593415065',id=9,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRyZaUOMSTTieQN3mhxzfhZFs6YRpbjtslD4TKh8eelwVK2hoPcIUM+kRmPIEzZG25ECBmYPy7YsNJJzXrL+gkFTQHOwG2MgQTPMaUC2A3BwR5+JQ5V/iwfCkpYEID1AA==',key_name='tempest-keypair-1912575311',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0ac13581ec1439eb3208cc3ddbec53a',ramdisk_id='',reservation_id='r-bqhy8nq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-461431762',owner_user_name='tempest-TaggedBootDevicesTest-461431762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72ed3093372d454e9f271d3d672ce8a2',uuid=31d8d6df-6235-4a05-a03b-b6d67c3698b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converting VIF {"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=10cbc52f-989f-4a58-9fea-8ca5184c55d3,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cbc52f-98') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=10cbc52f-989f-4a58-9fea-8ca5184c55d3,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cbc52f-98') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10cbc52f-98, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e68d2461-87bc-422a-b864-4eb527c1194e) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:12 user nova-compute[75453]: INFO os_vif [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=10cbc52f-989f-4a58-9fea-8ca5184c55d3,network=Network(656c93c1-5ed5-4278-bdbc-08d25d0e60ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cbc52f-98')
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zavUurtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:12 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9618659f-1ccd-4d46-89d5-4f914c7c6d37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:58:12 user nova-compute[75453]: No targets found.
Nov 28 13:58:12 user nova-compute[75453]: iSNS:
Nov 28 13:58:12 user nova-compute[75453]: No targets found.
Nov 28 13:58:12 user nova-compute[75453]: STATIC:
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: FIRMWARE:
Nov 28 13:58:12 user nova-compute[75453]: No targets found.
Nov 28 13:58:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:58:12 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:58:12 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1777db7-0488-4583-a697-dc2220ffc2a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabe6ba2-043d-41f3-a343-5b78861d7a61]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f024c156440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4250ba14-9098-4e7d-b8a4-33d214007098]: (4, ('path checker states:\nup                  11\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 1051721728 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fd0cf7-cbbb-4069-984f-381f7a31b7f7]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e441b2aa-6fef-4cc2-9540-1d7627d22a05]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9a21b61-5815-47ed-adac-040b1fc8e33a is timed out.
Nov 28 13:58:12 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Successfully detached device vdb from instance a9a21b61-5815-47ed-adac-040b1fc8e33a from the live domain config.
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWFeqNjP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:12 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f89c82e-0e81-499e-8590-75a63b46bf76]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7edbd44-e99c-4f31-9a4f-ac1386e97a23]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f201370-a13a-4538-96e6-d935ce075c66]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb, portal: 172.16.0.220,3260]
Nov 28 13:58:12 user nova-compute[75453]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb, portal: 172.16.0.220,3260] successful.
Nov 28 13:58:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c62840-e7a4-4bbb-861e-e4566ff910eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c98e6f2-1e3c-4576-9ad2-ed1c148475f9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] <== disconnect_volume: return (410ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.190s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHXpwlZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:12 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.060s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013179a-de7c-421e-ae4e-d2cffd96ae15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:58:12 user nova-compute[75453]: No targets found.
Nov 28 13:58:12 user nova-compute[75453]: iSNS:
Nov 28 13:58:12 user nova-compute[75453]: No targets found.
Nov 28 13:58:12 user nova-compute[75453]: STATIC:
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324
Nov 28 13:58:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:12 user nova-compute[75453]: FIRMWARE:
Nov 28 13:58:12 user nova-compute[75453]: No targets found.
Nov 28 13:58:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:58:12 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:58:12 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[685175f9-e75f-4436-b868-8078b594817d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f254a108-51d7-4a2e-94ba-81beac42470e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c1f7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f'): ({'sdk'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Removing single pathed devices sdk {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:58:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[49828b85-0299-463e-93fb-96eca581d20f]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[07195079-3f87-4f7b-ba9a-1789d5551f15]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Flushing IO for device /dev/sdk {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc22e4f1-025b-4345-93e9-72cda97f8356]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.037s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f25430-b8ba-44d5-ad0e-875e7e985250]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] SCSI volumes sdk have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b5e76b-ce3a-4702-946b-9b6c24146c6f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[07064292-601c-40e4-8eb2-6081d3bd8253]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f, portal: 172.16.0.220,3260]
Nov 28 13:58:13 user nova-compute[75453]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f, portal: 172.16.0.220,3260] successful.
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwQCvUtA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:13 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ee43782-0ea5-4236-bcb9-ea574a51fd6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b47563-9928-4f89-a7d1-b541f61ae393]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] <== disconnect_volume: return (609ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.422s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f23f7-346b-4dff-9fe0-2d833c14e1e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:58:13 user nova-compute[75453]: No targets found.
Nov 28 13:58:13 user nova-compute[75453]: iSNS:
Nov 28 13:58:13 user nova-compute[75453]: No targets found.
Nov 28 13:58:13 user nova-compute[75453]: STATIC:
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: FIRMWARE:
Nov 28 13:58:13 user nova-compute[75453]: No targets found.
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:58:13 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:58:13 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a40aed-3e03-4268-914f-6247639f172f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[628aa3c3-7160-4af4-8552-7d57d19c5e96]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c725510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef939554-bd4b-49da-99e3-79d8df494dfe]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b351776a-8f10-4d9f-ad55-48d812b33e13]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a90c1a-608b-4646-8c61-6cfd25fe1df9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd79fa24-da79-490a-be6e-01218e7d2b9a]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0052a15b-add9-4efb-919c-85afba522d6c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f93e95-fd1b-4d86-92e3-8e1d42b6faed]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397, portal: 172.16.0.220,3260]
Nov 28 13:58:13 user nova-compute[75453]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397, portal: 172.16.0.220,3260] successful.
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd24adeb-40e1-4836-a51a-a0948ce76397 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b34bad-3e1a-4cb3-8342-f4f8d4252b9a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] <== disconnect_volume: return (763ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.368s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVuvmRPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:13 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac1bdf0-8675-4f6c-b0e4-52a44d93538f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:58:13 user nova-compute[75453]: No targets found.
Nov 28 13:58:13 user nova-compute[75453]: iSNS:
Nov 28 13:58:13 user nova-compute[75453]: No targets found.
Nov 28 13:58:13 user nova-compute[75453]: STATIC:
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: FIRMWARE:
Nov 28 13:58:13 user nova-compute[75453]: No targets found.
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:58:13 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:58:13 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[87703954-1d3f-4164-8046-88b772f348d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19665bc-5f48-4b45-b5da-e3d7f3f92a7c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02541aeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7'): ({'sdj'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Removing single pathed devices sdj {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7f4fa7-b4c2-40c9-8a5d-5dd3bff70061]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c61b72a-7bc9-4f27-92eb-bb8c6cbe6fd9]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Flushing IO for device /dev/sdj {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0838f0f-38c9-4642-b08f-a8d566613a8a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e90e36-11dc-46a3-a253-28a546982c10]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] SCSI volumes sdj have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.compute.manager [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.compute.manager [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-unplugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.compute.manager [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-unplugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.compute.manager [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-plugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Acquiring lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.compute.manager [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] No waiting events found dispatching network-vif-plugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:13 user nova-compute[75453]: WARNING nova.compute.manager [req-21fbe938-9c23-4b86-8489-06f8e39ec17b req-c738a932-6632-4b87-a647-314d45888d5b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received unexpected event network-vif-plugged-10cbc52f-989f-4a58-9fea-8ca5184c55d3 for instance with vm_state active and task_state deleting.
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de7fe1a-da4e-4553-9448-0d963f565902]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4309ab9-175a-48a0-84db-f191bbdd3caa]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7, portal: 172.16.0.220,3260]
Nov 28 13:58:13 user nova-compute[75453]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7, portal: 172.16.0.220,3260] successful.
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2590ffd1-7637-4a90-ad5d-4209148c61a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ed01a-1c78-4c18-84a6-118aa4b6d348]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] <== disconnect_volume: return (702ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.335s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eef6556-e740-443f-94d7-0c23fed80496]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:58:13 user nova-compute[75453]: No targets found.
Nov 28 13:58:13 user nova-compute[75453]: iSNS:
Nov 28 13:58:13 user nova-compute[75453]: No targets found.
Nov 28 13:58:13 user nova-compute[75453]: STATIC:
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324
Nov 28 13:58:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:13 user nova-compute[75453]: FIRMWARE:
Nov 28 13:58:13 user nova-compute[75453]: No targets found.
Nov 28 13:58:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:58:13 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:58:13 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[468c90b1-fa52-4738-b7e7-ef0c417cd041]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMZbITkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, 'status': 'reserved', 'instance': '66c010a7-3604-41c4-9599-d41172a28fe2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4e3b65a-e2e0-4261-8f67-f4b561ad120c', 'serial'} {{(pid=75453) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] swap_volume: removing Cinder connection for volume 2590ffd1-7637-4a90-ad5d-4209148c61a7 {{(pid=75453) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaa95c2-ccb9-4912-bf20-fdd0a1bc0f2a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:14 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c1f6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324'): ({'sdd'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Removing single pathed devices sdd {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b928efa-dcb4-44e2-921b-31209cfb1f38]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d98585-4283-4929-ba02-c16772520172]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Flushing IO for device /dev/sdd {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdc1fb4-d8cc-459b-9a52-530ade5f88aa]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0619a57a-cec6-4bc8-96a1-c689c54b7670]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e399fb-a242-4a10-b880-f9db447594d3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eac05f4-076c-412c-bad9-1690875dfcbf]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324, portal: 172.16.0.220,3260]
Nov 28 13:58:14 user nova-compute[75453]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324, portal: 172.16.0.220,3260] successful.
Nov 28 13:58:14 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1359c5c-4f59-4469-a1bf-3edbe189d324 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[372b7f93-2f41-495d-b12a-dfa956568d6c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] <== disconnect_volume: return (699ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:58:14 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Deleting instance files /opt/stack/data/nova/instances/31d8d6df-6235-4a05-a03b-b6d67c3698b2_del
Nov 28 13:58:14 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Deletion of /opt/stack/data/nova/instances/31d8d6df-6235-4a05-a03b-b6d67c3698b2_del complete
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lazy-loading 'flavor' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:14 user nova-compute[75453]: INFO nova.compute.manager [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Took 5.19 seconds to destroy the instance on the hypervisor.
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c6854c6a-23e5-4b4d-9351-9a58a30df7ca tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.625s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "interface-a9a21b61-5815-47ed-adac-040b1fc8e33a-90a8cdca-86d8-40cc-990f-6a68ae35bd69" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "interface-a9a21b61-5815-47ed-adac-040b1fc8e33a-90a8cdca-86d8-40cc-990f-6a68ae35bd69" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.objects.instance [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lazy-loading 'flavor' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535040327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535040327',id=6,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ==',key_name='tempest-keypair-1885537121',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eb964406b0844ce997488844a2b0676',ramdisk_id='',reservation_id='r-nhd1qkbi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487095452',owner_user_name='tempest-TaggedAttachmentsTest-1487095452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c126fcfb0e4747ccaaf814d508698c55',uuid=a9a21b61-5815-47ed-adac-040b1fc8e33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converting VIF {"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface> {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface> {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Attempting to detach device tap90a8cdca-86 from instance a9a21b61-5815-47ed-adac-040b1fc8e33a from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] detach device xml: <interface type="ethernet">
Nov 28 13:58:14 user nova-compute[75453]:   <mac address="fa:16:3e:78:5d:3e"/>
Nov 28 13:58:14 user nova-compute[75453]:   <model type="virtio"/>
Nov 28 13:58:14 user nova-compute[75453]:   <mtu size="1442"/>
Nov 28 13:58:14 user nova-compute[75453]:   <target dev="tap90a8cdca-86"/>
Nov 28 13:58:14 user nova-compute[75453]: </interface>
Nov 28 13:58:14 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface> {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 28 13:58:14 user nova-compute[75453]:   <name>instance-00000006</name>
Nov 28 13:58:14 user nova-compute[75453]:   <uuid>a9a21b61-5815-47ed-adac-040b1fc8e33a</uuid>
Nov 28 13:58:14 user nova-compute[75453]:   <metadata>
Nov 28 13:58:14 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:58:14 user nova-compute[75453]:   <nova:package version="0.0.0"/>
Nov 28 13:58:14 user nova-compute[75453]:   <nova:name>tempest-device-tagging-server-535040327</nova:name>
Nov 28 13:58:14 user nova-compute[75453]:   <nova:creationTime>2023-11-28 13:57:39</nova:creationTime>
Nov 28 13:58:14 user nova-compute[75453]:   <nova:flavor name="m1.tiny">
Nov 28 13:58:14 user nova-compute[75453]:     <nova:memory>512</nova:memory>
Nov 28 13:58:14 user nova-compute[75453]:     <nova:disk>1</nova:disk>
Nov 28 13:58:14 user nova-compute[75453]:     <nova:swap>0</nova:swap>
Nov 28 13:58:14 user nova-compute[75453]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:58:14 user nova-compute[75453]:     <nova:vcpus>1</nova:vcpus>
Nov 28 13:58:14 user nova-compute[75453]:   </nova:flavor>
Nov 28 13:58:14 user nova-compute[75453]:   <nova:owner>
Nov 28 13:58:14 user nova-compute[75453]:     <nova:user uuid="c126fcfb0e4747ccaaf814d508698c55">tempest-TaggedAttachmentsTest-1487095452-project-member</nova:user>
Nov 28 13:58:14 user nova-compute[75453]:     <nova:project uuid="0eb964406b0844ce997488844a2b0676">tempest-TaggedAttachmentsTest-1487095452</nova:project>
Nov 28 13:58:14 user nova-compute[75453]:   </nova:owner>
Nov 28 13:58:14 user nova-compute[75453]:   <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:58:14 user nova-compute[75453]:   <nova:ports>
Nov 28 13:58:14 user nova-compute[75453]:     <nova:port uuid="885d9ccd-4b72-4063-b89a-ae6a3466a743">
Nov 28 13:58:14 user nova-compute[75453]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 13:58:14 user nova-compute[75453]:     </nova:port>
Nov 28 13:58:14 user nova-compute[75453]:     <nova:port uuid="90a8cdca-86d8-40cc-990f-6a68ae35bd69">
Nov 28 13:58:14 user nova-compute[75453]:       <nova:ip type="fixed" address="10.10.10.37" ipVersion="4"/>
Nov 28 13:58:14 user nova-compute[75453]:     </nova:port>
Nov 28 13:58:14 user nova-compute[75453]:   </nova:ports>
Nov 28 13:58:14 user nova-compute[75453]: </nova:instance>
Nov 28 13:58:14 user nova-compute[75453]:   </metadata>
Nov 28 13:58:14 user nova-compute[75453]:   <memory unit='KiB'>524288</memory>
Nov 28 13:58:14 user nova-compute[75453]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 13:58:14 user nova-compute[75453]:   <vcpu placement='static'>1</vcpu>
Nov 28 13:58:14 user nova-compute[75453]:   <resource>
Nov 28 13:58:14 user nova-compute[75453]:     <partition>/machine</partition>
Nov 28 13:58:14 user nova-compute[75453]:   </resource>
Nov 28 13:58:14 user nova-compute[75453]:   <sysinfo type='smbios'>
Nov 28 13:58:14 user nova-compute[75453]:     <system>
Nov 28 13:58:14 user nova-compute[75453]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 13:58:14 user nova-compute[75453]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 13:58:14 user nova-compute[75453]:       <entry name='version'>0.0.0</entry>
Nov 28 13:58:14 user nova-compute[75453]:       <entry name='serial'>a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:58:14 user nova-compute[75453]:       <entry name='uuid'>a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:58:14 user nova-compute[75453]:       <entry name='family'>Virtual Machine</entry>
Nov 28 13:58:14 user nova-compute[75453]:     </system>
Nov 28 13:58:14 user nova-compute[75453]:   </sysinfo>
Nov 28 13:58:14 user nova-compute[75453]:   <os>
Nov 28 13:58:14 user nova-compute[75453]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 13:58:14 user nova-compute[75453]:     <boot dev='hd'/>
Nov 28 13:58:14 user nova-compute[75453]:     <smbios mode='sysinfo'/>
Nov 28 13:58:14 user nova-compute[75453]:   </os>
Nov 28 13:58:14 user nova-compute[75453]:   <features>
Nov 28 13:58:14 user nova-compute[75453]:     <acpi/>
Nov 28 13:58:14 user nova-compute[75453]:     <apic/>
Nov 28 13:58:14 user nova-compute[75453]:     <vmcoreinfo state='on'/>
Nov 28 13:58:14 user nova-compute[75453]:   </features>
Nov 28 13:58:14 user nova-compute[75453]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 13:58:14 user nova-compute[75453]:     <model fallback='forbid'>Nehalem</model>
Nov 28 13:58:14 user nova-compute[75453]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 13:58:14 user nova-compute[75453]:     <feature policy='require' name='vme'/>
Nov 28 13:58:14 user nova-compute[75453]:     <feature policy='require' name='x2apic'/>
Nov 28 13:58:14 user nova-compute[75453]:     <feature policy='require' name='hypervisor'/>
Nov 28 13:58:14 user nova-compute[75453]:   </cpu>
Nov 28 13:58:14 user nova-compute[75453]:   <clock offset='utc'>
Nov 28 13:58:14 user nova-compute[75453]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 13:58:14 user nova-compute[75453]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 13:58:14 user nova-compute[75453]:     <timer name='hpet' present='no'/>
Nov 28 13:58:14 user nova-compute[75453]:   </clock>
Nov 28 13:58:14 user nova-compute[75453]:   <on_poweroff>destroy</on_poweroff>
Nov 28 13:58:14 user nova-compute[75453]:   <on_reboot>restart</on_reboot>
Nov 28 13:58:14 user nova-compute[75453]:   <on_crash>destroy</on_crash>
Nov 28 13:58:14 user nova-compute[75453]:   <devices>
Nov 28 13:58:14 user nova-compute[75453]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 13:58:14 user nova-compute[75453]:     <disk type='file' device='disk'>
Nov 28 13:58:14 user nova-compute[75453]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 13:58:14 user nova-compute[75453]:       <source file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk' index='2'/>
Nov 28 13:58:14 user nova-compute[75453]:       <backingStore type='file' index='3'>
Nov 28 13:58:14 user nova-compute[75453]:         <format type='raw'/>
Nov 28 13:58:14 user nova-compute[75453]:         <source file='/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d'/>
Nov 28 13:58:14 user nova-compute[75453]:         <backingStore/>
Nov 28 13:58:14 user nova-compute[75453]:       </backingStore>
Nov 28 13:58:14 user nova-compute[75453]:       <target dev='vda' bus='virtio'/>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='virtio-disk0'/>
Nov 28 13:58:14 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </disk>
Nov 28 13:58:14 user nova-compute[75453]:     <disk type='file' device='cdrom'>
Nov 28 13:58:14 user nova-compute[75453]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 13:58:14 user nova-compute[75453]:       <source file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.config' index='1'/>
Nov 28 13:58:14 user nova-compute[75453]:       <backingStore/>
Nov 28 13:58:14 user nova-compute[75453]:       <target dev='hda' bus='ide'/>
Nov 28 13:58:14 user nova-compute[75453]:       <readonly/>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='ide0-0-0'/>
Nov 28 13:58:14 user nova-compute[75453]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </disk>
Nov 28 13:58:14 user nova-compute[75453]:     <controller type='usb' index='0' model='none'>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='usb'/>
Nov 28 13:58:14 user nova-compute[75453]:     </controller>
Nov 28 13:58:14 user nova-compute[75453]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='pci.0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </controller>
Nov 28 13:58:14 user nova-compute[75453]:     <controller type='ide' index='0'>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='ide'/>
Nov 28 13:58:14 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 13:58:14 user nova-compute[75453]:     </controller>
Nov 28 13:58:14 user nova-compute[75453]:     <interface type='ethernet'>
Nov 28 13:58:14 user nova-compute[75453]:       <mac address='fa:16:3e:c2:b7:b3'/>
Nov 28 13:58:14 user nova-compute[75453]:       <target dev='tap885d9ccd-4b'/>
Nov 28 13:58:14 user nova-compute[75453]:       <model type='virtio'/>
Nov 28 13:58:14 user nova-compute[75453]:       <mtu size='1442'/>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='net0'/>
Nov 28 13:58:14 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </interface>
Nov 28 13:58:14 user nova-compute[75453]:     <interface type='ethernet'>
Nov 28 13:58:14 user nova-compute[75453]:       <mac address='fa:16:3e:78:5d:3e'/>
Nov 28 13:58:14 user nova-compute[75453]:       <target dev='tap90a8cdca-86'/>
Nov 28 13:58:14 user nova-compute[75453]:       <model type='virtio'/>
Nov 28 13:58:14 user nova-compute[75453]:       <mtu size='1442'/>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='net1'/>
Nov 28 13:58:14 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </interface>
Nov 28 13:58:14 user nova-compute[75453]:     <serial type='pty'>
Nov 28 13:58:14 user nova-compute[75453]:       <source path='/dev/pts/5'/>
Nov 28 13:58:14 user nova-compute[75453]:       <log file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log' append='off'/>
Nov 28 13:58:14 user nova-compute[75453]:       <target type='isa-serial' port='0'>
Nov 28 13:58:14 user nova-compute[75453]:         <model name='isa-serial'/>
Nov 28 13:58:14 user nova-compute[75453]:       </target>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='serial0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </serial>
Nov 28 13:58:14 user nova-compute[75453]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 13:58:14 user nova-compute[75453]:       <source path='/dev/pts/5'/>
Nov 28 13:58:14 user nova-compute[75453]:       <log file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log' append='off'/>
Nov 28 13:58:14 user nova-compute[75453]:       <target type='serial' port='0'/>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='serial0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </console>
Nov 28 13:58:14 user nova-compute[75453]:     <input type='mouse' bus='ps2'>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='input0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </input>
Nov 28 13:58:14 user nova-compute[75453]:     <input type='keyboard' bus='ps2'>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='input1'/>
Nov 28 13:58:14 user nova-compute[75453]:     </input>
Nov 28 13:58:14 user nova-compute[75453]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 13:58:14 user nova-compute[75453]:       <listen type='address' address='0.0.0.0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </graphics>
Nov 28 13:58:14 user nova-compute[75453]:     <audio id='1' type='none'/>
Nov 28 13:58:14 user nova-compute[75453]:     <video>
Nov 28 13:58:14 user nova-compute[75453]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='video0'/>
Nov 28 13:58:14 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </video>
Nov 28 13:58:14 user nova-compute[75453]:     <memballoon model='virtio'>
Nov 28 13:58:14 user nova-compute[75453]:       <stats period='10'/>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='balloon0'/>
Nov 28 13:58:14 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </memballoon>
Nov 28 13:58:14 user nova-compute[75453]:     <rng model='virtio'>
Nov 28 13:58:14 user nova-compute[75453]:       <backend model='random'>/dev/urandom</backend>
Nov 28 13:58:14 user nova-compute[75453]:       <alias name='rng0'/>
Nov 28 13:58:14 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 13:58:14 user nova-compute[75453]:     </rng>
Nov 28 13:58:14 user nova-compute[75453]:   </devices>
Nov 28 13:58:14 user nova-compute[75453]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 13:58:14 user nova-compute[75453]:     <label>libvirt-a9a21b61-5815-47ed-adac-040b1fc8e33a</label>
Nov 28 13:58:14 user nova-compute[75453]:     <imagelabel>libvirt-a9a21b61-5815-47ed-adac-040b1fc8e33a</imagelabel>
Nov 28 13:58:14 user nova-compute[75453]:   </seclabel>
Nov 28 13:58:14 user nova-compute[75453]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 13:58:14 user nova-compute[75453]:     <label>+64055:+108</label>
Nov 28 13:58:14 user nova-compute[75453]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 13:58:14 user nova-compute[75453]:   </seclabel>
Nov 28 13:58:14 user nova-compute[75453]: </domain>
Nov 28 13:58:14 user nova-compute[75453]:  {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 13:58:14 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Successfully detached device tap90a8cdca-86 from instance a9a21b61-5815-47ed-adac-040b1fc8e33a from the persistent domain config.
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] (1/8): Attempting to detach device tap90a8cdca-86 with device alias net1 from instance a9a21b61-5815-47ed-adac-040b1fc8e33a from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 13:58:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] detach device xml: <interface type="ethernet">
Nov 28 13:58:14 user nova-compute[75453]:   <mac address="fa:16:3e:78:5d:3e"/>
Nov 28 13:58:14 user nova-compute[75453]:   <model type="virtio"/>
Nov 28 13:58:14 user nova-compute[75453]:   <mtu size="1442"/>
Nov 28 13:58:14 user nova-compute[75453]:   <target dev="tap90a8cdca-86"/>
Nov 28 13:58:14 user nova-compute[75453]: </interface>
Nov 28 13:58:14 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Start waiting for the detach event from libvirt for device tap90a8cdca-86 with device alias net1 for instance a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG nova.compute.manager [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-unplugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG nova.compute.manager [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] No waiting events found dispatching network-vif-unplugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:15 user nova-compute[75453]: WARNING nova.compute.manager [req-9e92ae67-16e0-446f-a73a-ba366980a422 req-d816b26a-1075-4195-b0f8-4afa101b2f31 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received unexpected event network-vif-unplugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance with vm_state active and task_state None.
Nov 28 13:58:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] swap_volume: Updating volume 2590ffd1-7637-4a90-ad5d-4209148c61a7 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "eMZbITkS", "auth_password": "NmtrUyH8W7GYzL", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdm", "volume_id": "f4e3b65a-e2e0-4261-8f67-f4b561ad120c"}, "status": "reserved", "instance": "66c010a7-3604-41c4-9599-d41172a28fe2", "attached_at": "", "detached_at": "", "volume_id": "f4e3b65a-e2e0-4261-8f67-f4b561ad120c", "serial": "f4e3b65a-e2e0-4261-8f67-f4b561ad120c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f4e3b65a-e2e0-4261-8f67-f4b561ad120c', 'no_device': None, 'attachment_id': '24ca6531-c17c-4489-81fe-fe84e58fad89'} {{(pid=75453) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 13:58:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f70f7933-026b-4321-8f8b-60ded9007618 tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.592s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-deleted-03fc3793-a8b8-456b-a80f-c9c5d6925c0b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:16 user nova-compute[75453]: INFO nova.compute.manager [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Neutron deleted interface 03fc3793-a8b8-456b-a80f-c9c5d6925c0b; detaching it from the instance and deleting it from the info cache
Nov 28 13:58:16 user nova-compute[75453]: DEBUG nova.network.neutron [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [{"id": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "address": "fa:16:3e:03:ec:37", "network": {"id": "bbcbef15-20ec-4dd4-adb4-47914fd7aba4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1248054453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2348a0-f2", "ovs_interfaceid": "2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96485176-c454-4c24-bbe8-2cf688a69119", "address": "fa:16:3e:2c:22:9d", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96485176-c4", "ovs_interfaceid": "96485176-c454-4c24-bbe8-2cf688a69119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "address": "fa:16:3e:b6:40:1e", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5872e8ad-8a", "ovs_interfaceid": "5872e8ad-8a89-43f1-ab1f-b0b6b90f6de1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "address": "fa:16:3e:73:1e:c6", "network": {"id": "df5a3e5f-e2d5-416e-970f-b859d4c1f0fe", "bridge": "br-int", "label": "tempest-device-tagging-net1-779295295", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34e615b-e1", "ovs_interfaceid": "c34e615b-e133-4780-8a90-ca0fb5262dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf289519-83a0-4374-b2e5-757e5e7248f1", "address": "fa:16:3e:a6:45:3d", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf289519-83", "ovs_interfaceid": "cf289519-83a0-4374-b2e5-757e5e7248f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "address": "fa:16:3e:69:c0:66", "network": {"id": "656c93c1-5ed5-4278-bdbc-08d25d0e60ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-893386590", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c0ac13581ec1439eb3208cc3ddbec53a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cbc52f-98", "ovs_interfaceid": "10cbc52f-989f-4a58-9fea-8ca5184c55d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-21f63807-de7d-4900-8622-6105f7ee9777 req-d478a423-04ef-4404-8e05-0bbd581a856b service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Detach interface failed, port_id=03fc3793-a8b8-456b-a80f-c9c5d6925c0b, reason: Instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2 could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 13:58:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG os_brick.utils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afaa228-3a1c-422c-b9bf-88fdeea70cc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea516373-7dd5-40c7-b758-a863c59740b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8736909-f1fc-41a0-9bb4-5cbd7fb36078]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[df64546e-622b-4ce2-af63-0e49befe1921]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:58:17 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e5ca9b-f569-41e9-822b-05fca480f2f3]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG os_brick.utils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG nova.compute.manager [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-plugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:17 user nova-compute[75453]: DEBUG nova.compute.manager [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] No waiting events found dispatching network-vif-plugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:17 user nova-compute[75453]: WARNING nova.compute.manager [req-cb754897-5c24-4689-b690-a8c3cc52193c req-18a1a9fa-5b5f-412b-b891-cef5d4b425c7 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received unexpected event network-vif-plugged-90a8cdca-86d8-40cc-990f-6a68ae35bd69 for instance with vm_state active and task_state None.
Nov 28 13:58:17 user nova-compute[75453]: INFO nova.compute.manager [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Swapping volume f4e3b65a-e2e0-4261-8f67-f4b561ad120c for 2590ffd1-7637-4a90-ad5d-4209148c61a7
Nov 28 13:58:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:18 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:18 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Took 3.96 seconds to deallocate network for instance.
Nov 28 13:58:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-deleted-cf289519-83a0-4374-b2e5-757e5e7248f1 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-deleted-c34e615b-e133-4780-8a90-ca0fb5262dfe {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-deleted-2d2348a0-f21a-40fc-a3ce-251f7dd5f3f8 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-e1784be0-e30b-4e85-8b88-0041e5fd85be req-85ff913b-4a45-4983-adb0-26ba0d385b16 service nova] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Received event network-vif-deleted-10cbc52f-989f-4a58-9fea-8ca5184c55d3 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:19 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d is timed out.
Nov 28 13:58:19 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Successfully detached device vdb from instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d from the live domain config.
Nov 28 13:58:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhAUwWeO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:19 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee30e9f4-1de6-479b-9cc5-caf58ab42ba8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:58:19 user nova-compute[75453]: No targets found.
Nov 28 13:58:19 user nova-compute[75453]: iSNS:
Nov 28 13:58:19 user nova-compute[75453]: No targets found.
Nov 28 13:58:19 user nova-compute[75453]: STATIC:
Nov 28 13:58:19 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:58:19 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:19 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:19 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e
Nov 28 13:58:19 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:19 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:19 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:58:19 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:19 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:19 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0
Nov 28 13:58:19 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:19 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:19 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:58:19 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:19 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:19 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:58:19 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:19 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:19 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab
Nov 28 13:58:19 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:58:19 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:58:19 user nova-compute[75453]: FIRMWARE:
Nov 28 13:58:19 user nova-compute[75453]: No targets found.
Nov 28 13:58:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:58:20 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:58:20 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51a7fc4-edce-4ec2-92ca-50a598a0c69f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f7759a-e838-4cc8-af66-74d5436b8b02]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:20 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c610a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0'): ({'sdl'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Removing single pathed devices sdl {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab0fc2d-513e-4ee7-957e-28a6480ca232]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c1bc2b-1a95-4e63-a0bb-6bf461a2a48a]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Flushing IO for device /dev/sdl {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acedaf5-1d2f-4862-9e48-7902061721ac]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.048s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01e1ea8-5a0c-4ca6-8360-9995014b8562]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] SCSI volumes sdl have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a7b17f-8280-4f53-8ebe-370b687b3b5d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a63a17-c126-40b3-984b-0d7eb4e7c025]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0, portal: 172.16.0.220,3260]
Nov 28 13:58:20 user nova-compute[75453]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0, portal: 172.16.0.220,3260] successful.
Nov 28 13:58:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c256684c-2c3b-4052-8a85-942271fc83a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b811841c-ab90-4df4-b0b5-8d5f50fdcdb6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] <== disconnect_volume: return (456ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.volume.cinder [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Update attachment failed for attachment 5d4dde16-f1c6-4be8-ab92-b0a472fde1e5. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-670d7f08-8d2b-4a7f-b883-d7df6e6491c5) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-670d7f08-8d2b-4a7f-b883-d7df6e6491c5)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Failed to connect to volume 2590ffd1-7637-4a90-ad5d-4209148c61a7 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-670d7f08-8d2b-4a7f-b883-d7df6e6491c5)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Traceback (most recent call last):
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     new_cinfo = self.volume_api.attachment_update(
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     res = method(self, ctx, *args, **kwargs)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     with excutils.save_and_reraise_exception():
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     self.force_reraise()
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     raise self.value
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     context, '3.44', skip_version_check=True).attachments.update(
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     return method.func(obj, *args, **kwargs)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     resp = self._update('/attachments/%s' % id, body)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     return self._cs_request(url, 'PUT', **kwargs)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     return self.request(url, method, **kwargs)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2]     raise exceptions.from_response(resp, body)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-670d7f08-8d2b-4a7f-b883-d7df6e6491c5)
Nov 28 13:58:20 user nova-compute[75453]: ERROR nova.compute.manager [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] 
Nov 28 13:58:20 user nova-compute[75453]: INFO nova.compute.manager [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] [instance: 31d8d6df-6235-4a05-a03b-b6d67c3698b2] Took 2.55 seconds to detach 3 volumes for instance.
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 3.904s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server [None req-fdef55f9-e166-487f-9de8-4beeaa3d007a tempest-TestVolumeSwap-788986573 tempest-TestVolumeSwap-788986573-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-670d7f08-8d2b-4a7f-b883-d7df6e6491c5)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-670d7f08-8d2b-4a7f-b883-d7df6e6491c5)
Nov 28 13:58:21 user nova-compute[75453]: ERROR oslo_messaging.rpc.server 
Nov 28 13:58:21 user nova-compute[75453]: DEBUG nova.objects.instance [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lazy-loading 'flavor' on Instance uuid 57dc143b-7f7a-46e4-85c2-bed1c455b92d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a71e1ed2-4dfc-4c89-90c5-b6e13931d44b tempest-VolumesAssistedSnapshotsTest-1427202261 tempest-VolumesAssistedSnapshotsTest-1427202261-project-admin] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.826s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:21 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:58:21 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:58:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:21 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Deleted allocations for instance 31d8d6df-6235-4a05-a03b-b6d67c3698b2
Nov 28 13:58:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48c10fc6-82b6-4bd1-956d-5710e657c992 tempest-TaggedBootDevicesTest-461431762 tempest-TaggedBootDevicesTest-461431762-project-member] Lock "31d8d6df-6235-4a05-a03b-b6d67c3698b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.314s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 13:58:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 13:58:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 13:58:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "a51b39c5-001f-4f76-93c0-145fd3373cc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 13:58:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:24 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:58:24 user nova-compute[75453]: INFO nova.compute.claims [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Claim successful on node user
Nov 28 13:58:25 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 13:58:25 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 13:58:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG nova.policy [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9f9b1cc04a4417ebf987aa99a18e6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75b572682eb94af0b628ee30a16d9225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 13:58:25 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Creating image(s)
Nov 28 13:58:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "/opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "/opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "/opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.194s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk 1073741824" returned: 0 in 0.095s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Successfully created port: 70e39897-4a33-4d71-a525-84ce5c721830 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.201s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Cannot resize image /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Ensure instance console log exists: /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Successfully updated port: 70e39897-4a33-4d71-a525-84ce5c721830 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "refresh_cache-a51b39c5-001f-4f76-93c0-145fd3373cc2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquired lock "refresh_cache-a51b39c5-001f-4f76-93c0-145fd3373cc2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Received event network-changed-70e39897-4a33-4d71-a525-84ce5c721830 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Refreshing instance network info cache due to event network-changed-70e39897-4a33-4d71-a525-84ce5c721830. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] Acquiring lock "refresh_cache-a51b39c5-001f-4f76-93c0-145fd3373cc2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:58:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Updating instance_info_cache with network_info: [{"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Releasing lock "refresh_cache-a51b39c5-001f-4f76-93c0-145fd3373cc2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Instance network_info: |[{"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] Acquired lock "refresh_cache-a51b39c5-001f-4f76-93c0-145fd3373cc2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Refreshing network info cache for port 70e39897-4a33-4d71-a525-84ce5c721830 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Start _get_guest_xml network_info=[{"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:58:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:58:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:58:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1594648075',display_name='tempest-VolumesAdminNegativeTest-server-1594648075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1594648075',id=14,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75b572682eb94af0b628ee30a16d9225',ramdisk_id='',reservation_id='r-kir3mubv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-963761222',owner_user_name='tempest-VolumesAdminNegativeTest-963761222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:58:26Z,user_data=None,user_id='c9f9b1cc04a4417ebf987aa99a18e6a7',uuid=a51b39c5-001f-4f76-93c0-145fd3373cc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converting VIF {"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a1:df,bridge_name='br-int',has_traffic_filtering=True,id=70e39897-4a33-4d71-a525-84ce5c721830,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e39897-4a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.objects.instance [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lazy-loading 'pci_devices' on Instance uuid a51b39c5-001f-4f76-93c0-145fd3373cc2 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:58:27 user nova-compute[75453]:   <uuid>a51b39c5-001f-4f76-93c0-145fd3373cc2</uuid>
Nov 28 13:58:27 user nova-compute[75453]:   <name>instance-0000000e</name>
Nov 28 13:58:27 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:58:27 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:58:27 user nova-compute[75453]:   <metadata>
Nov 28 13:58:27 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:58:27 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:58:27 user nova-compute[75453]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1594648075</nova:name>
Nov 28 13:58:27 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:58:27</nova:creationTime>
Nov 28 13:58:27 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:58:27 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:58:27 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:58:27 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:58:27 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:58:27 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:58:27 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:58:27 user nova-compute[75453]:       <nova:owner>
Nov 28 13:58:27 user nova-compute[75453]:         <nova:user uuid="c9f9b1cc04a4417ebf987aa99a18e6a7">tempest-VolumesAdminNegativeTest-963761222-project-member</nova:user>
Nov 28 13:58:27 user nova-compute[75453]:         <nova:project uuid="75b572682eb94af0b628ee30a16d9225">tempest-VolumesAdminNegativeTest-963761222</nova:project>
Nov 28 13:58:27 user nova-compute[75453]:       </nova:owner>
Nov 28 13:58:27 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:58:27 user nova-compute[75453]:       <nova:ports>
Nov 28 13:58:27 user nova-compute[75453]:         <nova:port uuid="70e39897-4a33-4d71-a525-84ce5c721830">
Nov 28 13:58:27 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 13:58:27 user nova-compute[75453]:         </nova:port>
Nov 28 13:58:27 user nova-compute[75453]:       </nova:ports>
Nov 28 13:58:27 user nova-compute[75453]:     </nova:instance>
Nov 28 13:58:27 user nova-compute[75453]:   </metadata>
Nov 28 13:58:27 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:58:27 user nova-compute[75453]:     <system>
Nov 28 13:58:27 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:58:27 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:58:27 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:58:27 user nova-compute[75453]:       <entry name="serial">a51b39c5-001f-4f76-93c0-145fd3373cc2</entry>
Nov 28 13:58:27 user nova-compute[75453]:       <entry name="uuid">a51b39c5-001f-4f76-93c0-145fd3373cc2</entry>
Nov 28 13:58:27 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:58:27 user nova-compute[75453]:     </system>
Nov 28 13:58:27 user nova-compute[75453]:   </sysinfo>
Nov 28 13:58:27 user nova-compute[75453]:   <os>
Nov 28 13:58:27 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:58:27 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:58:27 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:58:27 user nova-compute[75453]:   </os>
Nov 28 13:58:27 user nova-compute[75453]:   <features>
Nov 28 13:58:27 user nova-compute[75453]:     <acpi/>
Nov 28 13:58:27 user nova-compute[75453]:     <apic/>
Nov 28 13:58:27 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:58:27 user nova-compute[75453]:   </features>
Nov 28 13:58:27 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:58:27 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:58:27 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:58:27 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:58:27 user nova-compute[75453]:   </clock>
Nov 28 13:58:27 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:58:27 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:58:27 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:58:27 user nova-compute[75453]:   </cpu>
Nov 28 13:58:27 user nova-compute[75453]:   <devices>
Nov 28 13:58:27 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:58:27 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:58:27 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk"/>
Nov 28 13:58:27 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:58:27 user nova-compute[75453]:     </disk>
Nov 28 13:58:27 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:58:27 user nova-compute[75453]:       <mac address="fa:16:3e:2b:a1:df"/>
Nov 28 13:58:27 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:58:27 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:58:27 user nova-compute[75453]:       <target dev="tap70e39897-4a"/>
Nov 28 13:58:27 user nova-compute[75453]:     </interface>
Nov 28 13:58:27 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:58:27 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/console.log" append="off"/>
Nov 28 13:58:27 user nova-compute[75453]:     </serial>
Nov 28 13:58:27 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:58:27 user nova-compute[75453]:     <video>
Nov 28 13:58:27 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:58:27 user nova-compute[75453]:     </video>
Nov 28 13:58:27 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:58:27 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:58:27 user nova-compute[75453]:     </rng>
Nov 28 13:58:27 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:58:27 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:58:27 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:58:27 user nova-compute[75453]:     </memballoon>
Nov 28 13:58:27 user nova-compute[75453]:   </devices>
Nov 28 13:58:27 user nova-compute[75453]: </domain>
Nov 28 13:58:27 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:58:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1594648075',display_name='tempest-VolumesAdminNegativeTest-server-1594648075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1594648075',id=14,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75b572682eb94af0b628ee30a16d9225',ramdisk_id='',reservation_id='r-kir3mubv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-963761222',owner_user_name='tempest-VolumesAdminNegativeTest-963761222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:58:26Z,user_data=None,user_id='c9f9b1cc04a4417ebf987aa99a18e6a7',uuid=a51b39c5-001f-4f76-93c0-145fd3373cc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converting VIF {"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a1:df,bridge_name='br-int',has_traffic_filtering=True,id=70e39897-4a33-4d71-a525-84ce5c721830,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e39897-4a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG os_vif [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a1:df,bridge_name='br-int',has_traffic_filtering=True,id=70e39897-4a33-4d71-a525-84ce5c721830,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e39897-4a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5011 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d1b1de9-b8b1-5e51-86b2-69793ced977e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70e39897-4a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70e39897-4a, col_values=(('qos', UUID('a6f16527-ebd8-4b80-84b0-38149418358a')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70e39897-4a, col_values=(('external_ids', {'iface-id': '70e39897-4a33-4d71-a525-84ce5c721830', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:a1:df', 'vm-uuid': 'a51b39c5-001f-4f76-93c0-145fd3373cc2'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:27 user nova-compute[75453]: INFO os_vif [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a1:df,bridge_name='br-int',has_traffic_filtering=True,id=70e39897-4a33-4d71-a525-84ce5c721830,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e39897-4a')
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] No VIF found with MAC fa:16:3e:2b:a1:df, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Updated VIF entry in instance network info cache for port 70e39897-4a33-4d71-a525-84ce5c721830. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Updating instance_info_cache with network_info: [{"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-029c1552-d1b3-48e1-a1c6-9fc77968efdc req-2ab7bca7-b6ad-4b93-8f4e-b3b7d9e13425 service nova] Releasing lock "refresh_cache-a51b39c5-001f-4f76-93c0-145fd3373cc2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:58:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Received event network-vif-plugged-70e39897-4a33-4d71-a525-84ce5c721830 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] Acquiring lock "a51b39c5-001f-4f76-93c0-145fd3373cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] No waiting events found dispatching network-vif-plugged-70e39897-4a33-4d71-a525-84ce5c721830 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:29 user nova-compute[75453]: WARNING nova.compute.manager [req-2e463fbc-505a-438b-b61f-bec0b678f367 req-6a8dbca4-e645-4e81-a8c2-8cfa6718d667 service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Received unexpected event network-vif-plugged-70e39897-4a33-4d71-a525-84ce5c721830 for instance with vm_state building and task_state spawning.
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 13:58:31 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Instance spawned successfully.
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Received event network-vif-plugged-70e39897-4a33-4d71-a525-84ce5c721830 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] Acquiring lock "a51b39c5-001f-4f76-93c0-145fd3373cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] No waiting events found dispatching network-vif-plugged-70e39897-4a33-4d71-a525-84ce5c721830 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:31 user nova-compute[75453]: WARNING nova.compute.manager [req-65c40460-3901-48e6-82fb-a5500bcee974 req-492ceba8-5b12-4741-9e4c-e7c3eae5897a service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Received unexpected event network-vif-plugged-70e39897-4a33-4d71-a525-84ce5c721830 for instance with vm_state building and task_state spawning.
Nov 28 13:58:31 user nova-compute[75453]: INFO nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 28 13:58:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:58:31 user nova-compute[75453]: INFO nova.compute.manager [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Took 6.43 seconds to build instance.
Nov 28 13:58:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-286981d9-55a1-4be0-a4d4-9547e5791a9f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.527s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Waiting for libvirt event about the detach of device tap90a8cdca-86 with device alias net1 from instance a9a21b61-5815-47ed-adac-040b1fc8e33a is timed out.
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface> {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 28 13:58:35 user nova-compute[75453]:   <name>instance-00000006</name>
Nov 28 13:58:35 user nova-compute[75453]:   <uuid>a9a21b61-5815-47ed-adac-040b1fc8e33a</uuid>
Nov 28 13:58:35 user nova-compute[75453]:   <metadata>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:58:35 user nova-compute[75453]:   <nova:package version="0.0.0"/>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:name>tempest-device-tagging-server-535040327</nova:name>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:creationTime>2023-11-28 13:57:39</nova:creationTime>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:flavor name="m1.tiny">
Nov 28 13:58:35 user nova-compute[75453]:     <nova:memory>512</nova:memory>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:disk>1</nova:disk>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:swap>0</nova:swap>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:vcpus>1</nova:vcpus>
Nov 28 13:58:35 user nova-compute[75453]:   </nova:flavor>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:owner>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:user uuid="c126fcfb0e4747ccaaf814d508698c55">tempest-TaggedAttachmentsTest-1487095452-project-member</nova:user>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:project uuid="0eb964406b0844ce997488844a2b0676">tempest-TaggedAttachmentsTest-1487095452</nova:project>
Nov 28 13:58:35 user nova-compute[75453]:   </nova:owner>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:ports>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:port uuid="885d9ccd-4b72-4063-b89a-ae6a3466a743">
Nov 28 13:58:35 user nova-compute[75453]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 13:58:35 user nova-compute[75453]:     </nova:port>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:port uuid="90a8cdca-86d8-40cc-990f-6a68ae35bd69">
Nov 28 13:58:35 user nova-compute[75453]:       <nova:ip type="fixed" address="10.10.10.37" ipVersion="4"/>
Nov 28 13:58:35 user nova-compute[75453]:     </nova:port>
Nov 28 13:58:35 user nova-compute[75453]:   </nova:ports>
Nov 28 13:58:35 user nova-compute[75453]: </nova:instance>
Nov 28 13:58:35 user nova-compute[75453]:   </metadata>
Nov 28 13:58:35 user nova-compute[75453]:   <memory unit='KiB'>524288</memory>
Nov 28 13:58:35 user nova-compute[75453]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 13:58:35 user nova-compute[75453]:   <vcpu placement='static'>1</vcpu>
Nov 28 13:58:35 user nova-compute[75453]:   <resource>
Nov 28 13:58:35 user nova-compute[75453]:     <partition>/machine</partition>
Nov 28 13:58:35 user nova-compute[75453]:   </resource>
Nov 28 13:58:35 user nova-compute[75453]:   <sysinfo type='smbios'>
Nov 28 13:58:35 user nova-compute[75453]:     <system>
Nov 28 13:58:35 user nova-compute[75453]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 13:58:35 user nova-compute[75453]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 13:58:35 user nova-compute[75453]:       <entry name='version'>0.0.0</entry>
Nov 28 13:58:35 user nova-compute[75453]:       <entry name='serial'>a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:58:35 user nova-compute[75453]:       <entry name='uuid'>a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:58:35 user nova-compute[75453]:       <entry name='family'>Virtual Machine</entry>
Nov 28 13:58:35 user nova-compute[75453]:     </system>
Nov 28 13:58:35 user nova-compute[75453]:   </sysinfo>
Nov 28 13:58:35 user nova-compute[75453]:   <os>
Nov 28 13:58:35 user nova-compute[75453]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 13:58:35 user nova-compute[75453]:     <boot dev='hd'/>
Nov 28 13:58:35 user nova-compute[75453]:     <smbios mode='sysinfo'/>
Nov 28 13:58:35 user nova-compute[75453]:   </os>
Nov 28 13:58:35 user nova-compute[75453]:   <features>
Nov 28 13:58:35 user nova-compute[75453]:     <acpi/>
Nov 28 13:58:35 user nova-compute[75453]:     <apic/>
Nov 28 13:58:35 user nova-compute[75453]:     <vmcoreinfo state='on'/>
Nov 28 13:58:35 user nova-compute[75453]:   </features>
Nov 28 13:58:35 user nova-compute[75453]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 13:58:35 user nova-compute[75453]:     <model fallback='forbid'>Nehalem</model>
Nov 28 13:58:35 user nova-compute[75453]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 13:58:35 user nova-compute[75453]:     <feature policy='require' name='vme'/>
Nov 28 13:58:35 user nova-compute[75453]:     <feature policy='require' name='x2apic'/>
Nov 28 13:58:35 user nova-compute[75453]:     <feature policy='require' name='hypervisor'/>
Nov 28 13:58:35 user nova-compute[75453]:   </cpu>
Nov 28 13:58:35 user nova-compute[75453]:   <clock offset='utc'>
Nov 28 13:58:35 user nova-compute[75453]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 13:58:35 user nova-compute[75453]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 13:58:35 user nova-compute[75453]:     <timer name='hpet' present='no'/>
Nov 28 13:58:35 user nova-compute[75453]:   </clock>
Nov 28 13:58:35 user nova-compute[75453]:   <on_poweroff>destroy</on_poweroff>
Nov 28 13:58:35 user nova-compute[75453]:   <on_reboot>restart</on_reboot>
Nov 28 13:58:35 user nova-compute[75453]:   <on_crash>destroy</on_crash>
Nov 28 13:58:35 user nova-compute[75453]:   <devices>
Nov 28 13:58:35 user nova-compute[75453]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 13:58:35 user nova-compute[75453]:     <disk type='file' device='disk'>
Nov 28 13:58:35 user nova-compute[75453]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 13:58:35 user nova-compute[75453]:       <source file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk' index='2'/>
Nov 28 13:58:35 user nova-compute[75453]:       <backingStore type='file' index='3'>
Nov 28 13:58:35 user nova-compute[75453]:         <format type='raw'/>
Nov 28 13:58:35 user nova-compute[75453]:         <source file='/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d'/>
Nov 28 13:58:35 user nova-compute[75453]:         <backingStore/>
Nov 28 13:58:35 user nova-compute[75453]:       </backingStore>
Nov 28 13:58:35 user nova-compute[75453]:       <target dev='vda' bus='virtio'/>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='virtio-disk0'/>
Nov 28 13:58:35 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </disk>
Nov 28 13:58:35 user nova-compute[75453]:     <disk type='file' device='cdrom'>
Nov 28 13:58:35 user nova-compute[75453]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 13:58:35 user nova-compute[75453]:       <source file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.config' index='1'/>
Nov 28 13:58:35 user nova-compute[75453]:       <backingStore/>
Nov 28 13:58:35 user nova-compute[75453]:       <target dev='hda' bus='ide'/>
Nov 28 13:58:35 user nova-compute[75453]:       <readonly/>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='ide0-0-0'/>
Nov 28 13:58:35 user nova-compute[75453]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </disk>
Nov 28 13:58:35 user nova-compute[75453]:     <controller type='usb' index='0' model='none'>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='usb'/>
Nov 28 13:58:35 user nova-compute[75453]:     </controller>
Nov 28 13:58:35 user nova-compute[75453]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='pci.0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </controller>
Nov 28 13:58:35 user nova-compute[75453]:     <controller type='ide' index='0'>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='ide'/>
Nov 28 13:58:35 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 13:58:35 user nova-compute[75453]:     </controller>
Nov 28 13:58:35 user nova-compute[75453]:     <interface type='ethernet'>
Nov 28 13:58:35 user nova-compute[75453]:       <mac address='fa:16:3e:c2:b7:b3'/>
Nov 28 13:58:35 user nova-compute[75453]:       <target dev='tap885d9ccd-4b'/>
Nov 28 13:58:35 user nova-compute[75453]:       <model type='virtio'/>
Nov 28 13:58:35 user nova-compute[75453]:       <mtu size='1442'/>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='net0'/>
Nov 28 13:58:35 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </interface>
Nov 28 13:58:35 user nova-compute[75453]:     <serial type='pty'>
Nov 28 13:58:35 user nova-compute[75453]:       <source path='/dev/pts/5'/>
Nov 28 13:58:35 user nova-compute[75453]:       <log file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log' append='off'/>
Nov 28 13:58:35 user nova-compute[75453]:       <target type='isa-serial' port='0'>
Nov 28 13:58:35 user nova-compute[75453]:         <model name='isa-serial'/>
Nov 28 13:58:35 user nova-compute[75453]:       </target>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='serial0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </serial>
Nov 28 13:58:35 user nova-compute[75453]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 13:58:35 user nova-compute[75453]:       <source path='/dev/pts/5'/>
Nov 28 13:58:35 user nova-compute[75453]:       <log file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log' append='off'/>
Nov 28 13:58:35 user nova-compute[75453]:       <target type='serial' port='0'/>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='serial0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </console>
Nov 28 13:58:35 user nova-compute[75453]:     <input type='mouse' bus='ps2'>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='input0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </input>
Nov 28 13:58:35 user nova-compute[75453]:     <input type='keyboard' bus='ps2'>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='input1'/>
Nov 28 13:58:35 user nova-compute[75453]:     </input>
Nov 28 13:58:35 user nova-compute[75453]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 13:58:35 user nova-compute[75453]:       <listen type='address' address='0.0.0.0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </graphics>
Nov 28 13:58:35 user nova-compute[75453]:     <audio id='1' type='none'/>
Nov 28 13:58:35 user nova-compute[75453]:     <video>
Nov 28 13:58:35 user nova-compute[75453]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='video0'/>
Nov 28 13:58:35 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </video>
Nov 28 13:58:35 user nova-compute[75453]:     <memballoon model='virtio'>
Nov 28 13:58:35 user nova-compute[75453]:       <stats period='10'/>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='balloon0'/>
Nov 28 13:58:35 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </memballoon>
Nov 28 13:58:35 user nova-compute[75453]:     <rng model='virtio'>
Nov 28 13:58:35 user nova-compute[75453]:       <backend model='random'>/dev/urandom</backend>
Nov 28 13:58:35 user nova-compute[75453]:       <alias name='rng0'/>
Nov 28 13:58:35 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 13:58:35 user nova-compute[75453]:     </rng>
Nov 28 13:58:35 user nova-compute[75453]:   </devices>
Nov 28 13:58:35 user nova-compute[75453]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 13:58:35 user nova-compute[75453]:     <label>libvirt-a9a21b61-5815-47ed-adac-040b1fc8e33a</label>
Nov 28 13:58:35 user nova-compute[75453]:     <imagelabel>libvirt-a9a21b61-5815-47ed-adac-040b1fc8e33a</imagelabel>
Nov 28 13:58:35 user nova-compute[75453]:   </seclabel>
Nov 28 13:58:35 user nova-compute[75453]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 13:58:35 user nova-compute[75453]:     <label>+64055:+108</label>
Nov 28 13:58:35 user nova-compute[75453]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 13:58:35 user nova-compute[75453]:   </seclabel>
Nov 28 13:58:35 user nova-compute[75453]: </domain>
Nov 28 13:58:35 user nova-compute[75453]:  {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 13:58:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Successfully detached device tap90a8cdca-86 from instance a9a21b61-5815-47ed-adac-040b1fc8e33a from the live domain config.
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535040327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535040327',id=6,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ==',key_name='tempest-keypair-1885537121',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eb964406b0844ce997488844a2b0676',ramdisk_id='',reservation_id='r-nhd1qkbi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487095452',owner_user_name='tempest-TaggedAttachmentsTest-1487095452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c126fcfb0e4747ccaaf814d508698c55',uuid=a9a21b61-5815-47ed-adac-040b1fc8e33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converting VIF {"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG os_vif [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90a8cdca-86, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=502338de-54ea-4a3c-a51f-994db918d298) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:35 user nova-compute[75453]: INFO os_vif [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86')
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:58:35 user nova-compute[75453]:   <nova:package version="0.0.0"/>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:name>tempest-device-tagging-server-535040327</nova:name>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:creationTime>2023-11-28 13:58:35</nova:creationTime>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:flavor name="m1.tiny">
Nov 28 13:58:35 user nova-compute[75453]:     <nova:memory>512</nova:memory>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:disk>1</nova:disk>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:swap>0</nova:swap>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:vcpus>1</nova:vcpus>
Nov 28 13:58:35 user nova-compute[75453]:   </nova:flavor>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:owner>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:user uuid="c126fcfb0e4747ccaaf814d508698c55">tempest-TaggedAttachmentsTest-1487095452-project-member</nova:user>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:project uuid="0eb964406b0844ce997488844a2b0676">tempest-TaggedAttachmentsTest-1487095452</nova:project>
Nov 28 13:58:35 user nova-compute[75453]:   </nova:owner>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:58:35 user nova-compute[75453]:   <nova:ports>
Nov 28 13:58:35 user nova-compute[75453]:     <nova:port uuid="885d9ccd-4b72-4063-b89a-ae6a3466a743">
Nov 28 13:58:35 user nova-compute[75453]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 13:58:35 user nova-compute[75453]:     </nova:port>
Nov 28 13:58:35 user nova-compute[75453]:   </nova:ports>
Nov 28 13:58:35 user nova-compute[75453]: </nova:instance>
Nov 28 13:58:35 user nova-compute[75453]:  {{(pid=75453) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-deleted-90a8cdca-86d8-40cc-990f-6a68ae35bd69 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:35 user nova-compute[75453]: INFO nova.compute.manager [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Neutron deleted interface 90a8cdca-86d8-40cc-990f-6a68ae35bd69; detaching it from the instance and deleting it from the info cache
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updating instance_info_cache with network_info: [{"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquired lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.network.neutron [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.objects.instance [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Lazy-loading 'system_metadata' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:35 user nova-compute[75453]: DEBUG nova.objects.instance [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Lazy-loading 'flavor' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.objects.base [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Object Instance<a9a21b61-5815-47ed-adac-040b1fc8e33a> lazy-loaded attributes: system_metadata,flavor {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535040327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535040327',id=6,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ==',key_name='tempest-keypair-1885537121',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eb964406b0844ce997488844a2b0676',ramdisk_id='',reservation_id='r-nhd1qkbi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487095452',owner_user_name='tempest-TaggedAttachmentsTest-1487095452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c126fcfb0e4747ccaaf814d508698c55',uuid=a9a21b61-5815-47ed-adac-040b1fc8e33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.network.os_vif_util [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Converting VIF {"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.network.os_vif_util [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface> {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 28 13:58:36 user nova-compute[75453]:   <name>instance-00000006</name>
Nov 28 13:58:36 user nova-compute[75453]:   <uuid>a9a21b61-5815-47ed-adac-040b1fc8e33a</uuid>
Nov 28 13:58:36 user nova-compute[75453]:   <metadata>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:58:36 user nova-compute[75453]:   <nova:package version="0.0.0"/>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:name>tempest-device-tagging-server-535040327</nova:name>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:creationTime>2023-11-28 13:58:35</nova:creationTime>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:flavor name="m1.tiny">
Nov 28 13:58:36 user nova-compute[75453]:     <nova:memory>512</nova:memory>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:disk>1</nova:disk>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:swap>0</nova:swap>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:vcpus>1</nova:vcpus>
Nov 28 13:58:36 user nova-compute[75453]:   </nova:flavor>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:owner>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:user uuid="c126fcfb0e4747ccaaf814d508698c55">tempest-TaggedAttachmentsTest-1487095452-project-member</nova:user>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:project uuid="0eb964406b0844ce997488844a2b0676">tempest-TaggedAttachmentsTest-1487095452</nova:project>
Nov 28 13:58:36 user nova-compute[75453]:   </nova:owner>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:ports>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:port uuid="885d9ccd-4b72-4063-b89a-ae6a3466a743">
Nov 28 13:58:36 user nova-compute[75453]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 13:58:36 user nova-compute[75453]:     </nova:port>
Nov 28 13:58:36 user nova-compute[75453]:   </nova:ports>
Nov 28 13:58:36 user nova-compute[75453]: </nova:instance>
Nov 28 13:58:36 user nova-compute[75453]:   </metadata>
Nov 28 13:58:36 user nova-compute[75453]:   <memory unit='KiB'>524288</memory>
Nov 28 13:58:36 user nova-compute[75453]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 13:58:36 user nova-compute[75453]:   <vcpu placement='static'>1</vcpu>
Nov 28 13:58:36 user nova-compute[75453]:   <resource>
Nov 28 13:58:36 user nova-compute[75453]:     <partition>/machine</partition>
Nov 28 13:58:36 user nova-compute[75453]:   </resource>
Nov 28 13:58:36 user nova-compute[75453]:   <sysinfo type='smbios'>
Nov 28 13:58:36 user nova-compute[75453]:     <system>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='version'>0.0.0</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='serial'>a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='uuid'>a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='family'>Virtual Machine</entry>
Nov 28 13:58:36 user nova-compute[75453]:     </system>
Nov 28 13:58:36 user nova-compute[75453]:   </sysinfo>
Nov 28 13:58:36 user nova-compute[75453]:   <os>
Nov 28 13:58:36 user nova-compute[75453]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 13:58:36 user nova-compute[75453]:     <boot dev='hd'/>
Nov 28 13:58:36 user nova-compute[75453]:     <smbios mode='sysinfo'/>
Nov 28 13:58:36 user nova-compute[75453]:   </os>
Nov 28 13:58:36 user nova-compute[75453]:   <features>
Nov 28 13:58:36 user nova-compute[75453]:     <acpi/>
Nov 28 13:58:36 user nova-compute[75453]:     <apic/>
Nov 28 13:58:36 user nova-compute[75453]:     <vmcoreinfo state='on'/>
Nov 28 13:58:36 user nova-compute[75453]:   </features>
Nov 28 13:58:36 user nova-compute[75453]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 13:58:36 user nova-compute[75453]:     <model fallback='forbid'>Nehalem</model>
Nov 28 13:58:36 user nova-compute[75453]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 13:58:36 user nova-compute[75453]:     <feature policy='require' name='vme'/>
Nov 28 13:58:36 user nova-compute[75453]:     <feature policy='require' name='x2apic'/>
Nov 28 13:58:36 user nova-compute[75453]:     <feature policy='require' name='hypervisor'/>
Nov 28 13:58:36 user nova-compute[75453]:   </cpu>
Nov 28 13:58:36 user nova-compute[75453]:   <clock offset='utc'>
Nov 28 13:58:36 user nova-compute[75453]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 13:58:36 user nova-compute[75453]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 13:58:36 user nova-compute[75453]:     <timer name='hpet' present='no'/>
Nov 28 13:58:36 user nova-compute[75453]:   </clock>
Nov 28 13:58:36 user nova-compute[75453]:   <on_poweroff>destroy</on_poweroff>
Nov 28 13:58:36 user nova-compute[75453]:   <on_reboot>restart</on_reboot>
Nov 28 13:58:36 user nova-compute[75453]:   <on_crash>destroy</on_crash>
Nov 28 13:58:36 user nova-compute[75453]:   <devices>
Nov 28 13:58:36 user nova-compute[75453]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 13:58:36 user nova-compute[75453]:     <disk type='file' device='disk'>
Nov 28 13:58:36 user nova-compute[75453]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 13:58:36 user nova-compute[75453]:       <source file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk' index='2'/>
Nov 28 13:58:36 user nova-compute[75453]:       <backingStore type='file' index='3'>
Nov 28 13:58:36 user nova-compute[75453]:         <format type='raw'/>
Nov 28 13:58:36 user nova-compute[75453]:         <source file='/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d'/>
Nov 28 13:58:36 user nova-compute[75453]:         <backingStore/>
Nov 28 13:58:36 user nova-compute[75453]:       </backingStore>
Nov 28 13:58:36 user nova-compute[75453]:       <target dev='vda' bus='virtio'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='virtio-disk0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </disk>
Nov 28 13:58:36 user nova-compute[75453]:     <disk type='file' device='cdrom'>
Nov 28 13:58:36 user nova-compute[75453]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 13:58:36 user nova-compute[75453]:       <source file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.config' index='1'/>
Nov 28 13:58:36 user nova-compute[75453]:       <backingStore/>
Nov 28 13:58:36 user nova-compute[75453]:       <target dev='hda' bus='ide'/>
Nov 28 13:58:36 user nova-compute[75453]:       <readonly/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='ide0-0-0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </disk>
Nov 28 13:58:36 user nova-compute[75453]:     <controller type='usb' index='0' model='none'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='usb'/>
Nov 28 13:58:36 user nova-compute[75453]:     </controller>
Nov 28 13:58:36 user nova-compute[75453]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='pci.0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </controller>
Nov 28 13:58:36 user nova-compute[75453]:     <controller type='ide' index='0'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='ide'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 13:58:36 user nova-compute[75453]:     </controller>
Nov 28 13:58:36 user nova-compute[75453]:     <interface type='ethernet'>
Nov 28 13:58:36 user nova-compute[75453]:       <mac address='fa:16:3e:c2:b7:b3'/>
Nov 28 13:58:36 user nova-compute[75453]:       <target dev='tap885d9ccd-4b'/>
Nov 28 13:58:36 user nova-compute[75453]:       <model type='virtio'/>
Nov 28 13:58:36 user nova-compute[75453]:       <mtu size='1442'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='net0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </interface>
Nov 28 13:58:36 user nova-compute[75453]:     <serial type='pty'>
Nov 28 13:58:36 user nova-compute[75453]:       <source path='/dev/pts/5'/>
Nov 28 13:58:36 user nova-compute[75453]:       <log file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log' append='off'/>
Nov 28 13:58:36 user nova-compute[75453]:       <target type='isa-serial' port='0'>
Nov 28 13:58:36 user nova-compute[75453]:         <model name='isa-serial'/>
Nov 28 13:58:36 user nova-compute[75453]:       </target>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='serial0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </serial>
Nov 28 13:58:36 user nova-compute[75453]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 13:58:36 user nova-compute[75453]:       <source path='/dev/pts/5'/>
Nov 28 13:58:36 user nova-compute[75453]:       <log file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log' append='off'/>
Nov 28 13:58:36 user nova-compute[75453]:       <target type='serial' port='0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='serial0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </console>
Nov 28 13:58:36 user nova-compute[75453]:     <input type='mouse' bus='ps2'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='input0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </input>
Nov 28 13:58:36 user nova-compute[75453]:     <input type='keyboard' bus='ps2'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='input1'/>
Nov 28 13:58:36 user nova-compute[75453]:     </input>
Nov 28 13:58:36 user nova-compute[75453]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 13:58:36 user nova-compute[75453]:       <listen type='address' address='0.0.0.0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </graphics>
Nov 28 13:58:36 user nova-compute[75453]:     <audio id='1' type='none'/>
Nov 28 13:58:36 user nova-compute[75453]:     <video>
Nov 28 13:58:36 user nova-compute[75453]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='video0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </video>
Nov 28 13:58:36 user nova-compute[75453]:     <memballoon model='virtio'>
Nov 28 13:58:36 user nova-compute[75453]:       <stats period='10'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='balloon0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </memballoon>
Nov 28 13:58:36 user nova-compute[75453]:     <rng model='virtio'>
Nov 28 13:58:36 user nova-compute[75453]:       <backend model='random'>/dev/urandom</backend>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='rng0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </rng>
Nov 28 13:58:36 user nova-compute[75453]:   </devices>
Nov 28 13:58:36 user nova-compute[75453]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 13:58:36 user nova-compute[75453]:     <label>libvirt-a9a21b61-5815-47ed-adac-040b1fc8e33a</label>
Nov 28 13:58:36 user nova-compute[75453]:     <imagelabel>libvirt-a9a21b61-5815-47ed-adac-040b1fc8e33a</imagelabel>
Nov 28 13:58:36 user nova-compute[75453]:   </seclabel>
Nov 28 13:58:36 user nova-compute[75453]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 13:58:36 user nova-compute[75453]:     <label>+64055:+108</label>
Nov 28 13:58:36 user nova-compute[75453]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 13:58:36 user nova-compute[75453]:   </seclabel>
Nov 28 13:58:36 user nova-compute[75453]: </domain>
Nov 28 13:58:36 user nova-compute[75453]:  {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface> {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:78:5d:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap90a8cdca-86"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 28 13:58:36 user nova-compute[75453]:   <name>instance-00000006</name>
Nov 28 13:58:36 user nova-compute[75453]:   <uuid>a9a21b61-5815-47ed-adac-040b1fc8e33a</uuid>
Nov 28 13:58:36 user nova-compute[75453]:   <metadata>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:58:36 user nova-compute[75453]:   <nova:package version="0.0.0"/>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:name>tempest-device-tagging-server-535040327</nova:name>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:creationTime>2023-11-28 13:58:35</nova:creationTime>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:flavor name="m1.tiny">
Nov 28 13:58:36 user nova-compute[75453]:     <nova:memory>512</nova:memory>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:disk>1</nova:disk>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:swap>0</nova:swap>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:vcpus>1</nova:vcpus>
Nov 28 13:58:36 user nova-compute[75453]:   </nova:flavor>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:owner>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:user uuid="c126fcfb0e4747ccaaf814d508698c55">tempest-TaggedAttachmentsTest-1487095452-project-member</nova:user>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:project uuid="0eb964406b0844ce997488844a2b0676">tempest-TaggedAttachmentsTest-1487095452</nova:project>
Nov 28 13:58:36 user nova-compute[75453]:   </nova:owner>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:ports>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:port uuid="885d9ccd-4b72-4063-b89a-ae6a3466a743">
Nov 28 13:58:36 user nova-compute[75453]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 13:58:36 user nova-compute[75453]:     </nova:port>
Nov 28 13:58:36 user nova-compute[75453]:   </nova:ports>
Nov 28 13:58:36 user nova-compute[75453]: </nova:instance>
Nov 28 13:58:36 user nova-compute[75453]:   </metadata>
Nov 28 13:58:36 user nova-compute[75453]:   <memory unit='KiB'>524288</memory>
Nov 28 13:58:36 user nova-compute[75453]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 13:58:36 user nova-compute[75453]:   <vcpu placement='static'>1</vcpu>
Nov 28 13:58:36 user nova-compute[75453]:   <resource>
Nov 28 13:58:36 user nova-compute[75453]:     <partition>/machine</partition>
Nov 28 13:58:36 user nova-compute[75453]:   </resource>
Nov 28 13:58:36 user nova-compute[75453]:   <sysinfo type='smbios'>
Nov 28 13:58:36 user nova-compute[75453]:     <system>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='version'>0.0.0</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='serial'>a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='uuid'>a9a21b61-5815-47ed-adac-040b1fc8e33a</entry>
Nov 28 13:58:36 user nova-compute[75453]:       <entry name='family'>Virtual Machine</entry>
Nov 28 13:58:36 user nova-compute[75453]:     </system>
Nov 28 13:58:36 user nova-compute[75453]:   </sysinfo>
Nov 28 13:58:36 user nova-compute[75453]:   <os>
Nov 28 13:58:36 user nova-compute[75453]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 13:58:36 user nova-compute[75453]:     <boot dev='hd'/>
Nov 28 13:58:36 user nova-compute[75453]:     <smbios mode='sysinfo'/>
Nov 28 13:58:36 user nova-compute[75453]:   </os>
Nov 28 13:58:36 user nova-compute[75453]:   <features>
Nov 28 13:58:36 user nova-compute[75453]:     <acpi/>
Nov 28 13:58:36 user nova-compute[75453]:     <apic/>
Nov 28 13:58:36 user nova-compute[75453]:     <vmcoreinfo state='on'/>
Nov 28 13:58:36 user nova-compute[75453]:   </features>
Nov 28 13:58:36 user nova-compute[75453]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 13:58:36 user nova-compute[75453]:     <model fallback='forbid'>Nehalem</model>
Nov 28 13:58:36 user nova-compute[75453]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 13:58:36 user nova-compute[75453]:     <feature policy='require' name='vme'/>
Nov 28 13:58:36 user nova-compute[75453]:     <feature policy='require' name='x2apic'/>
Nov 28 13:58:36 user nova-compute[75453]:     <feature policy='require' name='hypervisor'/>
Nov 28 13:58:36 user nova-compute[75453]:   </cpu>
Nov 28 13:58:36 user nova-compute[75453]:   <clock offset='utc'>
Nov 28 13:58:36 user nova-compute[75453]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 13:58:36 user nova-compute[75453]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 13:58:36 user nova-compute[75453]:     <timer name='hpet' present='no'/>
Nov 28 13:58:36 user nova-compute[75453]:   </clock>
Nov 28 13:58:36 user nova-compute[75453]:   <on_poweroff>destroy</on_poweroff>
Nov 28 13:58:36 user nova-compute[75453]:   <on_reboot>restart</on_reboot>
Nov 28 13:58:36 user nova-compute[75453]:   <on_crash>destroy</on_crash>
Nov 28 13:58:36 user nova-compute[75453]:   <devices>
Nov 28 13:58:36 user nova-compute[75453]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 13:58:36 user nova-compute[75453]:     <disk type='file' device='disk'>
Nov 28 13:58:36 user nova-compute[75453]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 13:58:36 user nova-compute[75453]:       <source file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk' index='2'/>
Nov 28 13:58:36 user nova-compute[75453]:       <backingStore type='file' index='3'>
Nov 28 13:58:36 user nova-compute[75453]:         <format type='raw'/>
Nov 28 13:58:36 user nova-compute[75453]:         <source file='/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d'/>
Nov 28 13:58:36 user nova-compute[75453]:         <backingStore/>
Nov 28 13:58:36 user nova-compute[75453]:       </backingStore>
Nov 28 13:58:36 user nova-compute[75453]:       <target dev='vda' bus='virtio'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='virtio-disk0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </disk>
Nov 28 13:58:36 user nova-compute[75453]:     <disk type='file' device='cdrom'>
Nov 28 13:58:36 user nova-compute[75453]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 13:58:36 user nova-compute[75453]:       <source file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk.config' index='1'/>
Nov 28 13:58:36 user nova-compute[75453]:       <backingStore/>
Nov 28 13:58:36 user nova-compute[75453]:       <target dev='hda' bus='ide'/>
Nov 28 13:58:36 user nova-compute[75453]:       <readonly/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='ide0-0-0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </disk>
Nov 28 13:58:36 user nova-compute[75453]:     <controller type='usb' index='0' model='none'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='usb'/>
Nov 28 13:58:36 user nova-compute[75453]:     </controller>
Nov 28 13:58:36 user nova-compute[75453]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='pci.0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </controller>
Nov 28 13:58:36 user nova-compute[75453]:     <controller type='ide' index='0'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='ide'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 13:58:36 user nova-compute[75453]:     </controller>
Nov 28 13:58:36 user nova-compute[75453]:     <interface type='ethernet'>
Nov 28 13:58:36 user nova-compute[75453]:       <mac address='fa:16:3e:c2:b7:b3'/>
Nov 28 13:58:36 user nova-compute[75453]:       <target dev='tap885d9ccd-4b'/>
Nov 28 13:58:36 user nova-compute[75453]:       <model type='virtio'/>
Nov 28 13:58:36 user nova-compute[75453]:       <mtu size='1442'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='net0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </interface>
Nov 28 13:58:36 user nova-compute[75453]:     <serial type='pty'>
Nov 28 13:58:36 user nova-compute[75453]:       <source path='/dev/pts/5'/>
Nov 28 13:58:36 user nova-compute[75453]:       <log file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log' append='off'/>
Nov 28 13:58:36 user nova-compute[75453]:       <target type='isa-serial' port='0'>
Nov 28 13:58:36 user nova-compute[75453]:         <model name='isa-serial'/>
Nov 28 13:58:36 user nova-compute[75453]:       </target>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='serial0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </serial>
Nov 28 13:58:36 user nova-compute[75453]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 13:58:36 user nova-compute[75453]:       <source path='/dev/pts/5'/>
Nov 28 13:58:36 user nova-compute[75453]:       <log file='/opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/console.log' append='off'/>
Nov 28 13:58:36 user nova-compute[75453]:       <target type='serial' port='0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='serial0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </console>
Nov 28 13:58:36 user nova-compute[75453]:     <input type='mouse' bus='ps2'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='input0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </input>
Nov 28 13:58:36 user nova-compute[75453]:     <input type='keyboard' bus='ps2'>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='input1'/>
Nov 28 13:58:36 user nova-compute[75453]:     </input>
Nov 28 13:58:36 user nova-compute[75453]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 13:58:36 user nova-compute[75453]:       <listen type='address' address='0.0.0.0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </graphics>
Nov 28 13:58:36 user nova-compute[75453]:     <audio id='1' type='none'/>
Nov 28 13:58:36 user nova-compute[75453]:     <video>
Nov 28 13:58:36 user nova-compute[75453]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='video0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </video>
Nov 28 13:58:36 user nova-compute[75453]:     <memballoon model='virtio'>
Nov 28 13:58:36 user nova-compute[75453]:       <stats period='10'/>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='balloon0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </memballoon>
Nov 28 13:58:36 user nova-compute[75453]:     <rng model='virtio'>
Nov 28 13:58:36 user nova-compute[75453]:       <backend model='random'>/dev/urandom</backend>
Nov 28 13:58:36 user nova-compute[75453]:       <alias name='rng0'/>
Nov 28 13:58:36 user nova-compute[75453]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 13:58:36 user nova-compute[75453]:     </rng>
Nov 28 13:58:36 user nova-compute[75453]:   </devices>
Nov 28 13:58:36 user nova-compute[75453]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 13:58:36 user nova-compute[75453]:     <label>libvirt-a9a21b61-5815-47ed-adac-040b1fc8e33a</label>
Nov 28 13:58:36 user nova-compute[75453]:     <imagelabel>libvirt-a9a21b61-5815-47ed-adac-040b1fc8e33a</imagelabel>
Nov 28 13:58:36 user nova-compute[75453]:   </seclabel>
Nov 28 13:58:36 user nova-compute[75453]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 13:58:36 user nova-compute[75453]:     <label>+64055:+108</label>
Nov 28 13:58:36 user nova-compute[75453]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 13:58:36 user nova-compute[75453]:   </seclabel>
Nov 28 13:58:36 user nova-compute[75453]: </domain>
Nov 28 13:58:36 user nova-compute[75453]:  {{(pid=75453) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 13:58:36 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Detaching interface fa:16:3e:78:5d:3e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap90a8cdca-86' not found.
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535040327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535040327',id=6,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ==',key_name='tempest-keypair-1885537121',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eb964406b0844ce997488844a2b0676',ramdisk_id='',reservation_id='r-nhd1qkbi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487095452',owner_user_name='tempest-TaggedAttachmentsTest-1487095452-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c126fcfb0e4747ccaaf814d508698c55',uuid=a9a21b61-5815-47ed-adac-040b1fc8e33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.network.os_vif_util [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Converting VIF {"id": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "address": "fa:16:3e:78:5d:3e", "network": {"id": "712bbcaf-8256-462f-b634-23fb0fbd983e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2060779371", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90a8cdca-86", "ovs_interfaceid": "90a8cdca-86d8-40cc-990f-6a68ae35bd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.network.os_vif_util [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG os_vif [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90a8cdca-86, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:58:36 user nova-compute[75453]: INFO os_vif [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:5d:3e,bridge_name='br-int',has_traffic_filtering=True,id=90a8cdca-86d8-40cc-990f-6a68ae35bd69,network=Network(712bbcaf-8256-462f-b634-23fb0fbd983e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90a8cdca-86')
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [req-b131ff99-af20-4ef7-9847-d735ef9ae71d req-9aa3de5b-31bc-4955-8d56-32757b71ade8 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:58:36 user nova-compute[75453]:   <nova:package version="0.0.0"/>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:name>tempest-device-tagging-server-535040327</nova:name>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:creationTime>2023-11-28 13:58:36</nova:creationTime>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:flavor name="m1.tiny">
Nov 28 13:58:36 user nova-compute[75453]:     <nova:memory>512</nova:memory>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:disk>1</nova:disk>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:swap>0</nova:swap>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:vcpus>1</nova:vcpus>
Nov 28 13:58:36 user nova-compute[75453]:   </nova:flavor>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:owner>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:user uuid="c126fcfb0e4747ccaaf814d508698c55">tempest-TaggedAttachmentsTest-1487095452-project-member</nova:user>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:project uuid="0eb964406b0844ce997488844a2b0676">tempest-TaggedAttachmentsTest-1487095452</nova:project>
Nov 28 13:58:36 user nova-compute[75453]:   </nova:owner>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:58:36 user nova-compute[75453]:   <nova:ports>
Nov 28 13:58:36 user nova-compute[75453]:     <nova:port uuid="885d9ccd-4b72-4063-b89a-ae6a3466a743">
Nov 28 13:58:36 user nova-compute[75453]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 13:58:36 user nova-compute[75453]:     </nova:port>
Nov 28 13:58:36 user nova-compute[75453]:   </nova:ports>
Nov 28 13:58:36 user nova-compute[75453]: </nova:instance>
Nov 28 13:58:36 user nova-compute[75453]:  {{(pid=75453) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG nova.network.neutron [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updating instance_info_cache with network_info: [{"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Releasing lock "refresh_cache-a9a21b61-5815-47ed-adac-040b1fc8e33a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:58:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf06d36f-e43d-4ae8-9f0d-32907aadc57b tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "interface-a9a21b61-5815-47ed-adac-040b1fc8e33a-90a8cdca-86d8-40cc-990f-6a68ae35bd69" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.747s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received event network-changed-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Refreshing instance network info cache due to event network-changed-1543b940-0c84-4e66-b424-f3c6fbd8c737. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:58:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] Acquiring lock "refresh_cache-21bca975-80ab-4d17-8a2d-9435c5f9646f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:58:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] Acquired lock "refresh_cache-21bca975-80ab-4d17-8a2d-9435c5f9646f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:58:44 user nova-compute[75453]: DEBUG nova.network.neutron [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Refreshing network info cache for port 1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:58:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:44 user nova-compute[75453]: DEBUG nova.objects.instance [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'flavor' on Instance uuid 21bca975-80ab-4d17-8a2d-9435c5f9646f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:44 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Ignoring supplied device name: /dev/vdb
Nov 28 13:58:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:45 user nova-compute[75453]: INFO nova.compute.manager [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Attaching volume 56478f59-9340-4f10-83f7-bbeee4419867 to /dev/vdb
Nov 28 13:58:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Updated VIF entry in instance network info cache for port 1543b940-0c84-4e66-b424-f3c6fbd8c737. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Updating instance_info_cache with network_info: [{"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9483fc0c-45c4-46b8-ad8c-e13c51819396 req-cb32081d-35d8-4517-a678-b39c0163c730 service nova] Releasing lock "refresh_cache-21bca975-80ab-4d17-8a2d-9435c5f9646f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG os_brick.utils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a5843-4b3d-4110-98d2-b047bc52f17f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96bf133-9af8-430f-93dc-090c9861a668]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ac0a00-8b4b-49ae-a6bc-4d8ed1ed3a63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef05e5f9-e2bc-420c-a7de-dfef98e6a450]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:58:45 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:58:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[910df004-5b97-41f3-b621-66260933c829]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG os_brick.utils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:45 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Updating existing volume attachment record: 5142f3c1-8040-4277-868f-7b36a1afa8be {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:58:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:50 user nova-compute[75453]: INFO nova.compute.manager [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Terminating instance
Nov 28 13:58:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received event network-vif-unplugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] Acquiring lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] No waiting events found dispatching network-vif-unplugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-fe210191-b133-4ed8-99d0-73f1268d20f3 req-307002b8-90a2-44cb-9da2-4ac9ac62fdd6 service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received event network-vif-unplugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:51 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Instance destroyed successfully.
Nov 28 13:58:51 user nova-compute[75453]: DEBUG nova.objects.instance [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lazy-loading 'resources' on Instance uuid eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1115132190',display_name='tempest-ServersNegativeTestJSON-server-1115132190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1115132190',id=12,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f9642956daa4507a3b6791bcd41d9d3',ramdisk_id='',reservation_id='r-f410lr8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2071230602',owner_user_name='tempest-ServersNegativeTestJSON-2071230602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:11Z,user_data=None,user_id='237e50c8ccfa49169a1bdca99f46e616',uuid=eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converting VIF {"id": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "address": "fa:16:3e:38:b9:90", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9729fc6f-44", "ovs_interfaceid": "9729fc6f-4406-4ec7-9f32-1938bd85d524", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:90,bridge_name='br-int',has_traffic_filtering=True,id=9729fc6f-4406-4ec7-9f32-1938bd85d524,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9729fc6f-44') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG os_vif [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:90,bridge_name='br-int',has_traffic_filtering=True,id=9729fc6f-4406-4ec7-9f32-1938bd85d524,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9729fc6f-44') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9729fc6f-44, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad7ed009-2d39-4da8-8a41-2be355ca0328) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:51 user nova-compute[75453]: INFO os_vif [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:b9:90,bridge_name='br-int',has_traffic_filtering=True,id=9729fc6f-4406-4ec7-9f32-1938bd85d524,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9729fc6f-44')
Nov 28 13:58:51 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Deleting instance files /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b_del
Nov 28 13:58:51 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Deletion of /opt/stack/data/nova/instances/eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b_del complete
Nov 28 13:58:51 user nova-compute[75453]: INFO nova.compute.manager [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Took 0.81 seconds to destroy the instance on the hypervisor.
Nov 28 13:58:51 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:51 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Took 0.44 seconds to deallocate network for instance.
Nov 28 13:58:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:52 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:58:52 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:58:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:52 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Deleted allocations for instance eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b
Nov 28 13:58:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-639975b8-3307-4517-a3bb-e4591c36bb9e tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.212s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received event network-vif-plugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] Acquiring lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] Lock "eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] No waiting events found dispatching network-vif-plugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:53 user nova-compute[75453]: WARNING nova.compute.manager [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received unexpected event network-vif-plugged-9729fc6f-4406-4ec7-9f32-1938bd85d524 for instance with vm_state deleted and task_state None.
Nov 28 13:58:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-9f948524-2aa7-4bbb-839f-613c6eb2ccb1 req-28921c61-0fa2-4ecc-8a09-07a78f0de59a service nova] [instance: eeaf5c25-a9b6-45e4-81e5-a7a8f32aa04b] Received event network-vif-deleted-9729fc6f-4406-4ec7-9f32-1938bd85d524 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:54 user nova-compute[75453]: INFO nova.compute.manager [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Terminating instance
Nov 28 13:58:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received event network-vif-unplugged-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] No waiting events found dispatching network-vif-unplugged-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-44c8eab4-6f5e-4867-8154-4697ed95b302 req-2c32c12f-7d4d-4ee0-a2b9-7528b1959a4e service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received event network-vif-unplugged-0b01647b-3ee6-4152-adac-c584772d441a for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:58:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Instance destroyed successfully.
Nov 28 13:58:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lazy-loading 'resources' on Instance uuid 57dc143b-7f7a-46e4-85c2-bed1c455b92d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-775124193',display_name='tempest-VolumesAssistedSnapshotsTest-server-775124193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-775124193',id=8,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCI7gVF0ciHiIMVAJZbprWHL7zURwQNS0Z7LcSqMKBqZ4iid4/3E0j/cFAiCmqvQgRBJ7cRgNWmkMO5eTy2VY9d4WYAn8RfhPs9LVIcR+tbmQ11oSnDXM+sw9EFjRsdGw==',key_name='tempest-keypair-1355928653',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:56:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31479b67e7b34434a9498cb6b982d4f7',ramdisk_id='',reservation_id='r-zoqvoulk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1977047969',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1977047969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:56:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39fa3c5315ca4202bd2fdde394f2ccba',uuid=57dc143b-7f7a-46e4-85c2-bed1c455b92d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Converting VIF {"id": "0b01647b-3ee6-4152-adac-c584772d441a", "address": "fa:16:3e:b1:8f:02", "network": {"id": "51f3b6a3-ef05-464a-a3df-dcd433b3e54c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1718110318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31479b67e7b34434a9498cb6b982d4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b01647b-3e", "ovs_interfaceid": "0b01647b-3ee6-4152-adac-c584772d441a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:8f:02,bridge_name='br-int',has_traffic_filtering=True,id=0b01647b-3ee6-4152-adac-c584772d441a,network=Network(51f3b6a3-ef05-464a-a3df-dcd433b3e54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b01647b-3e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG os_vif [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:8f:02,bridge_name='br-int',has_traffic_filtering=True,id=0b01647b-3ee6-4152-adac-c584772d441a,network=Network(51f3b6a3-ef05-464a-a3df-dcd433b3e54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b01647b-3e') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b01647b-3e, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a180346c-c85c-47c7-baf0-589e2164fe35) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:55 user nova-compute[75453]: INFO os_vif [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:8f:02,bridge_name='br-int',has_traffic_filtering=True,id=0b01647b-3ee6-4152-adac-c584772d441a,network=Network(51f3b6a3-ef05-464a-a3df-dcd433b3e54c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b01647b-3e')
Nov 28 13:58:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Deleting instance files /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d_del
Nov 28 13:58:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Deletion of /opt/stack/data/nova/instances/57dc143b-7f7a-46e4-85c2-bed1c455b92d_del complete
Nov 28 13:58:55 user nova-compute[75453]: INFO nova.compute.manager [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 13:58:55 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 13:58:55 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received event network-vif-deleted-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:56 user nova-compute[75453]: INFO nova.compute.manager [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Neutron deleted interface 0b01647b-3ee6-4152-adac-c584772d441a; detaching it from the instance and deleting it from the info cache
Nov 28 13:58:56 user nova-compute[75453]: DEBUG nova.network.neutron [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:56 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Took 0.92 seconds to deallocate network for instance.
Nov 28 13:58:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-590a85d3-f7ff-4283-811d-02455d9b240d req-92249d0f-7e64-4ede-8fb5-35598d0ae287 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Detach interface failed, port_id=0b01647b-3ee6-4152-adac-c584772d441a, reason: Instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received event network-vif-plugged-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] Acquiring lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] No waiting events found dispatching network-vif-plugged-0b01647b-3ee6-4152-adac-c584772d441a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:58:56 user nova-compute[75453]: WARNING nova.compute.manager [req-47d8b888-b646-40c6-be1a-d13e44f88e04 req-ef004e34-bf61-4bff-811b-01eeb0c9d372 service nova] [instance: 57dc143b-7f7a-46e4-85c2-bed1c455b92d] Received unexpected event network-vif-plugged-0b01647b-3ee6-4152-adac-c584772d441a for instance with vm_state deleted and task_state None.
Nov 28 13:58:56 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Deleted allocations for instance 57dc143b-7f7a-46e4-85c2-bed1c455b92d
Nov 28 13:58:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:58:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-945f81d9-f530-47e5-bfa9-5c735de6debf tempest-VolumesAssistedSnapshotsTest-1977047969 tempest-VolumesAssistedSnapshotsTest-1977047969-project-member] Lock "57dc143b-7f7a-46e4-85c2-bed1c455b92d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.716s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuaMbehG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:58 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:58 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:58:58 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e03b89-5ea3-4311-9b40-70d717d5030c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:58:58 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0c2aac-b5f8-42f4-835b-05e0f6f4e6d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867] added
Nov 28 13:58:58 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b5093-6a9f-426e-a054-204a5586838c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73206a6-e007-4d5d-8f3b-9d76cf571abe]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuaMbehG {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuaMbehG" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28c761f-9836-407f-9e4e-eb45668dad41]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LuaMbehG'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f209d5f-2e32-4483-b935-9fce0437f6ae]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[28915a6d-c1f3-4481-89c4-0d74d9af444b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4284fa5-5ef2-401f-9555-3ac9eb715a70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867, portal: 172.16.0.220,3260]
Nov 28 13:58:58 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867, portal: 172.16.0.220,3260] successful.
Nov 28 13:58:58 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3babbc69-983d-480a-b900-d3f7990bc3e8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d56193f-2277-48dd-b142-f155a92b5310]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:58:58 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0206063-a876-49e7-89f6-d3d1c1702ce6]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-changed-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing instance network info cache due to event network-changed-540a415e-6e64-4d9f-ba49-ec2a1a85439a. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] Acquiring lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] Acquired lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG nova.network.neutron [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Refreshing network info cache for port 540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lazy-loading 'flavor' on Instance uuid 9a32cb51-7b87-4d9b-9e94-72cb60f4371f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:58:59 user nova-compute[75453]: INFO nova.compute.manager [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Attaching volume 95820667-5de5-45e2-a99e-67643abf1bb1 to /dev/vdb
Nov 28 13:58:59 user nova-compute[75453]: DEBUG nova.network.neutron [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updated VIF entry in instance network info cache for port 540a415e-6e64-4d9f-ba49-ec2a1a85439a. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG nova.network.neutron [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [{"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8f3aef7d-7ad2-4c88-970b-fe6b18c0a229 req-47b1cfa2-94bc-49b3-a59a-b1e8ba407e67 service nova] Releasing lock "refresh_cache-794937d9-3c23-41cf-bb74-767e93bc1370" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.utils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[100dc5b9-921e-47d9-9c88-6b6c508b36b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[994c1a2d-7511-45d6-a243-6557dc1e9605]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f83a7-09f1-4a9a-97d4-5e118eff8b63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[321192d3-1d7b-47c5-a033-3720705c5636]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:58:59 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:58:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5649e5cc-8396-495d-842c-2bbbbf3fc5c4]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.utils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating existing volume attachment record: dd36f696-1393-411c-81fe-83ac5bf0bd7c {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuaMbehG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23866363661613864', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866363661613864', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG nova.objects.instance [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'flavor' on Instance uuid 21bca975-80ab-4d17-8a2d-9435c5f9646f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:58:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 13:58:59 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:58:59 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 13:58:59 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:58:59 user nova-compute[75453]:   <serial>56478f59-9340-4f10-83f7-bbeee4419867</serial>
Nov 28 13:58:59 user nova-compute[75453]: </disk>
Nov 28 13:58:59 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 13:59:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:59:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:59:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No VIF found with MAC fa:16:3e:e5:c4:27, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:59:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-56dedfee-a0c4-4235-bcfc-0ba3449767e3 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.520s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "794937d9-3c23-41cf-bb74-767e93bc1370" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:01 user nova-compute[75453]: INFO nova.compute.manager [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Terminating instance
Nov 28 13:59:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-unplugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-b25b7847-ba12-4caa-86b1-c76cae4bb952 req-2d5720ec-0bfe-4d06-9c20-1b8e6ef73c61 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-unplugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-c630bc54-805f-4911-8dd6-3a686e5c3d00 req-37633bc4-9e84-440d-8dbf-afaa1449f5da service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-unplugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-9142257b-43f6-437b-95f9-6ae755390d08 req-2727c2e9-0a2c-4352-8300-5b20d918e42f service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Instance destroyed successfully.
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lazy-loading 'resources' on Instance uuid 794937d9-3c23-41cf-bb74-767e93bc1370 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:5a:6b,bridge_name='br-int',has_traffic_filtering=True,id=540a415e-6e64-4d9f-ba49-ec2a1a85439a,network=Network(b7880457-5d82-42a8-a9eb-7bd4fe365367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540a415e-6e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:5a:6b,bridge_name='br-int',has_traffic_filtering=True,id=540a415e-6e64-4d9f-ba49-ec2a1a85439a,network=Network(b7880457-5d82-42a8-a9eb-7bd4fe365367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540a415e-6e') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap540a415e-6e, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6e40dab-1dc3-475f-9cd5-bb995d09e90a) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: INFO os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:5a:6b,bridge_name='br-int',has_traffic_filtering=True,id=540a415e-6e64-4d9f-ba49-ec2a1a85439a,network=Network(b7880457-5d82-42a8-a9eb-7bd4fe365367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540a415e-6e')
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:cb:4c,bridge_name='br-int',has_traffic_filtering=True,id=c91797e6-0bbb-48ea-b5c2-278b0b4319ef,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc91797e6-0b') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cb:4c,bridge_name='br-int',has_traffic_filtering=True,id=c91797e6-0bbb-48ea-b5c2-278b0b4319ef,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc91797e6-0b') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc91797e6-0b, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccd33cde-7067-4134-aea9-3dc4533c0041) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: INFO os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cb:4c,bridge_name='br-int',has_traffic_filtering=True,id=c91797e6-0bbb-48ea-b5c2-278b0b4319ef,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc91797e6-0b')
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0d:ae,bridge_name='br-int',has_traffic_filtering=True,id=605c90e8-31d1-4efa-b5c1-de9f7eeaec51,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap605c90e8-31') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0d:ae,bridge_name='br-int',has_traffic_filtering=True,id=605c90e8-31d1-4efa-b5c1-de9f7eeaec51,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap605c90e8-31') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap605c90e8-31, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ec48ba8-25e6-46b0-bfc1-1d7847275fa1) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: INFO os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0d:ae,bridge_name='br-int',has_traffic_filtering=True,id=605c90e8-31d1-4efa-b5c1-de9f7eeaec51,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap605c90e8-31')
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a2:41,bridge_name='br-int',has_traffic_filtering=True,id=edf36fdd-4dd8-4465-8669-37b6adf82416,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf36fdd-4d') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a2:41,bridge_name='br-int',has_traffic_filtering=True,id=edf36fdd-4dd8-4465-8669-37b6adf82416,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf36fdd-4d') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedf36fdd-4d, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a69ce2c8-b008-4382-83ad-bc07deb642e7) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: INFO os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a2:41,bridge_name='br-int',has_traffic_filtering=True,id=edf36fdd-4dd8-4465-8669-37b6adf82416,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf36fdd-4d')
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:05:7e,bridge_name='br-int',has_traffic_filtering=True,id=9daa350f-1a8b-41c9-8fd4-52e99d65b25f,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9daa350f-1a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:05:7e,bridge_name='br-int',has_traffic_filtering=True,id=9daa350f-1a8b-41c9-8fd4-52e99d65b25f,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9daa350f-1a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:03 user nova-compute[75453]: WARNING nova.compute.manager [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-605c90e8-31d1-4efa-b5c1-de9f7eeaec51 for instance with vm_state active and task_state deleting.
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-unplugged-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-edf36fdd-4dd8-4465-8669-37b6adf82416 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:03 user nova-compute[75453]: WARNING nova.compute.manager [req-514780f8-16af-4d0a-9133-23dad79cb149 req-003768ed-2dbb-4d83-aa44-9c110f9c6707 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-edf36fdd-4dd8-4465-8669-37b6adf82416 for instance with vm_state active and task_state deleting.
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9daa350f-1a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f3e4bda-df8c-44d7-90fc-e93395bff1c6) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:04 user nova-compute[75453]: WARNING nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-540a415e-6e64-4d9f-ba49-ec2a1a85439a for instance with vm_state active and task_state deleting.
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-unplugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:04 user nova-compute[75453]: WARNING nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-c91797e6-0bbb-48ea-b5c2-278b0b4319ef for instance with vm_state active and task_state deleting.
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-unplugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:04 user nova-compute[75453]: WARNING nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-9daa350f-1a8b-41c9-8fd4-52e99d65b25f for instance with vm_state active and task_state deleting.
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-unplugged-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-unplugged-494d17d8-bf46-4767-852b-4e578ef43377 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:04 user nova-compute[75453]: WARNING nova.compute.manager [req-02a19967-f0fe-4559-8756-f33822230526 req-ccde52d5-a7bc-4bd7-85d2-a36a34f3aa9b service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-494d17d8-bf46-4767-852b-4e578ef43377 for instance with vm_state active and task_state deleting.
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:04 user nova-compute[75453]: INFO os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:05:7e,bridge_name='br-int',has_traffic_filtering=True,id=9daa350f-1a8b-41c9-8fd4-52e99d65b25f,network=Network(7e1f4582-88e4-4ecd-b385-35a0e8fa5179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9daa350f-1a')
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "address": "fa:16:3e:fc:c0:0d", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6e94133-9c", "ovs_interfaceid": "a6e94133-9c6d-4d82-a2fe-56e7b65450bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=a6e94133-9c6d-4d82-a2fe-56e7b65450bb,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e94133-9c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=a6e94133-9c6d-4d82-a2fe-56e7b65450bb,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e94133-9c') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6e94133-9c, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53675b7d-6892-4f91-8ea9-264c54fcdc1e) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: INFO os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=a6e94133-9c6d-4d82-a2fe-56e7b65450bb,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6e94133-9c')
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-493600760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-493600760',id=10,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBZdGyEu4HCUJO2i+1ZrP5diz3MxfMsmjQhErsipIDyuYBTosWHU52ZDLFb0rr2/fMuSsfgVxyZZcdHn7Lg5eHEzZMJt4FQpKnEQN1n0HMhIDKECNK6UpfKVKWrXX6NjA==',key_name='tempest-keypair-1794267935',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112860fded124331bc667a597f4c695d',ramdisk_id='',reservation_id='r-8fe9i9w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237344816',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237344816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a16ed449c2e749fcafc01dd97b83241a',uuid=794937d9-3c23-41cf-bb74-767e93bc1370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converting VIF {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:b2:e5,bridge_name='br-int',has_traffic_filtering=True,id=494d17d8-bf46-4767-852b-4e578ef43377,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d17d8-bf') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:b2:e5,bridge_name='br-int',has_traffic_filtering=True,id=494d17d8-bf46-4767-852b-4e578ef43377,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d17d8-bf') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap494d17d8-bf, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8735f15b-7d85-4e36-9571-8bf31b169b1c) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: INFO os_vif [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:b2:e5,bridge_name='br-int',has_traffic_filtering=True,id=494d17d8-bf46-4767-852b-4e578ef43377,network=Network(8e2471c7-dcf3-42c4-afce-c881d0ad2d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494d17d8-bf')
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmdlMhzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:04 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c2fa42-bd33-4fd4-8d02-7022aa76ebb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:59:04 user nova-compute[75453]: No targets found.
Nov 28 13:59:04 user nova-compute[75453]: iSNS:
Nov 28 13:59:04 user nova-compute[75453]: No targets found.
Nov 28 13:59:04 user nova-compute[75453]: STATIC:
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: FIRMWARE:
Nov 28 13:59:04 user nova-compute[75453]: No targets found.
Nov 28 13:59:04 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:59:04 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:59:04 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e043266d-0108-47b0-8c71-575edb27390a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b83da22-17b5-4d1c-8cf7-96db407e23a2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c5a2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab'): ({'sde'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Removing single pathed devices sde {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cc151b-3d24-4956-a17c-d11a97a2b7df]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-plugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] Acquiring lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] Lock "794937d9-3c23-41cf-bb74-767e93bc1370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] No waiting events found dispatching network-vif-plugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:04 user nova-compute[75453]: WARNING nova.compute.manager [req-cadedc1f-fe55-4688-8c96-6c37c94f3342 req-90e30096-8676-4843-8d84-82f3322d92c9 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received unexpected event network-vif-plugged-a6e94133-9c6d-4d82-a2fe-56e7b65450bb for instance with vm_state active and task_state deleting.
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5844d6be-c842-4a65-8438-3a7562203155]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Flushing IO for device /dev/sde {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[440fcefa-2730-4515-b4da-eb0a70fa0998]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c3b7aa-1ace-49d3-9c1e-2af0a7df2f4b]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.056s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[517f748f-576c-4bb0-9abb-cbbf46097e8c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[db257321-fdd9-4d59-8df1-1428498c56d4]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab, portal: 172.16.0.220,3260]
Nov 28 13:59:04 user nova-compute[75453]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab, portal: 172.16.0.220,3260] successful.
Nov 28 13:59:04 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ef3fc0-9e51-4dec-bb48-5113d0dde6ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9ca9f7-1b84-40c8-9438-4f85c2fd58ea]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.512s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] <== disconnect_volume: return (515ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnVwSJHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:04 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e07b46-37fa-40cd-87a8-0bc17641d9ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:59:04 user nova-compute[75453]: No targets found.
Nov 28 13:59:04 user nova-compute[75453]: iSNS:
Nov 28 13:59:04 user nova-compute[75453]: No targets found.
Nov 28 13:59:04 user nova-compute[75453]: STATIC:
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:59:04 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:04 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:04 user nova-compute[75453]: FIRMWARE:
Nov 28 13:59:04 user nova-compute[75453]: No targets found.
Nov 28 13:59:04 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:59:04 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:59:04 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a201448-81c3-4636-a039-ff9b70c6dffe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f9f296-a0ba-4a5d-a9e0-deb656f985ae]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:04 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f021875f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e'): ({'sdf'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Removing single pathed devices sdf {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9f9f6d-eee4-46cc-adc7-9acff15b0600]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c0b81-67cb-45f6-8fad-30037d3b99dc]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Flushing IO for device /dev/sdf {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e988b953-4838-46fd-8356-a659a1f6317c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:59:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb10195b-5e9b-4727-84bc-92815a8e9bfd]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] SCSI volumes sdf have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb8d0b5-6280-4701-afa1-4fb0c8fea8c9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1a0025-2682-4c7d-a27f-0f879b513118]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e, portal: 172.16.0.220,3260]
Nov 28 13:59:05 user nova-compute[75453]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e, portal: 172.16.0.220,3260] successful.
Nov 28 13:59:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f223225d-9bf0-4bf1-bf9e-a4f6d1419a7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d249fb2-f718-49df-a742-c788ad536c63]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] <== disconnect_volume: return (425ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYhdaNnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:05 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328e5e8-afe1-4f3d-8190-f37276675b5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:59:05 user nova-compute[75453]: No targets found.
Nov 28 13:59:05 user nova-compute[75453]: iSNS:
Nov 28 13:59:05 user nova-compute[75453]: No targets found.
Nov 28 13:59:05 user nova-compute[75453]: STATIC:
Nov 28 13:59:05 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:59:05 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:05 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:05 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:59:05 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:05 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:05 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867
Nov 28 13:59:05 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:05 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:05 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:59:05 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:05 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:05 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1
Nov 28 13:59:05 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:05 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:05 user nova-compute[75453]: FIRMWARE:
Nov 28 13:59:05 user nova-compute[75453]: No targets found.
Nov 28 13:59:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:59:05 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:59:05 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cba7ad-6021-47fb-8e9f-123b11b41622]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[545da6d7-cb84-496f-8534-42b4ae21e5b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:05 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:05 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:59:05 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:05 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:05 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:05 user nova-compute[75453]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 (non-flash)
Nov 28 13:59:05 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:05 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02543a39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1'): ({'sdg'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Removing single pathed devices sdg {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f9d6ab-8dc8-4af0-9301-53551e40b106]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7734b7ce-7c06-46b1-9c20-f57e61baafb4]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Flushing IO for device /dev/sdg {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db49428-1a01-4824-9f4c-6325a5a166a8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff25ae1-e2c1-42c8-87b6-201ea1c80a3e]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] SCSI volumes sdg have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4615fb71-5a09-4b45-8e7e-480e0b5361fe]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:05 user nova-compute[75453]: INFO nova.compute.manager [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Terminating instance
Nov 28 13:59:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[886750cb-c191-43b2-86b4-e4d29f96c79e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1, portal: 172.16.0.220,3260]
Nov 28 13:59:05 user nova-compute[75453]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1, portal: 172.16.0.220,3260] successful.
Nov 28 13:59:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4143e1d-5911-4ff6-a035-e7c81788faa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acc6787-0ce9-4454-88c4-1fc01a2fda69]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.479s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] <== disconnect_volume: return (483ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:59:05 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Deleting instance files /opt/stack/data/nova/instances/794937d9-3c23-41cf-bb74-767e93bc1370_del
Nov 28 13:59:05 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Deletion of /opt/stack/data/nova/instances/794937d9-3c23-41cf-bb74-767e93bc1370_del complete
Nov 28 13:59:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:05 user nova-compute[75453]: INFO nova.compute.manager [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Took 4.64 seconds to destroy the instance on the hypervisor.
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-unplugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] No waiting events found dispatching network-vif-unplugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-1cf0a0dd-0de7-4837-8cb1-fe0824d68e65 req-54a234a6-f46c-4064-935b-3a19028464dc service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-unplugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:06 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Instance destroyed successfully.
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lazy-loading 'resources' on Instance uuid a9a21b61-5815-47ed-adac-040b1fc8e33a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T13:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535040327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535040327',id=6,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqN0pKc0uvb/kMlR+Orr8+m/QzEKsUrTA5aaodpfbILrbCCd1dInW9SIEk5+BtNvQK7FbQMNWoUQQTbIpuZ9/V86eLTcJczhf7YFrWWxtPxE0NCYS3CBqjzTIq5oGlnQ==',key_name='tempest-keypair-1885537121',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eb964406b0844ce997488844a2b0676',ramdisk_id='',reservation_id='r-nhd1qkbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487095452',owner_user_name='tempest-TaggedAttachmentsTest-1487095452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c126fcfb0e4747ccaaf814d508698c55',uuid=a9a21b61-5815-47ed-adac-040b1fc8e33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converting VIF {"id": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "address": "fa:16:3e:c2:b7:b3", "network": {"id": "d123dddc-c4d6-4211-a9d5-6579178447f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-482329041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eb964406b0844ce997488844a2b0676", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885d9ccd-4b", "ovs_interfaceid": "885d9ccd-4b72-4063-b89a-ae6a3466a743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=885d9ccd-4b72-4063-b89a-ae6a3466a743,network=Network(d123dddc-c4d6-4211-a9d5-6579178447f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885d9ccd-4b') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG os_vif [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=885d9ccd-4b72-4063-b89a-ae6a3466a743,network=Network(d123dddc-c4d6-4211-a9d5-6579178447f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885d9ccd-4b') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap885d9ccd-4b, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80cd11cc-db84-4e51-b4eb-f4eb8cd46cac) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:06 user nova-compute[75453]: INFO os_vif [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=885d9ccd-4b72-4063-b89a-ae6a3466a743,network=Network(d123dddc-c4d6-4211-a9d5-6579178447f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885d9ccd-4b')
Nov 28 13:59:06 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Deleting instance files /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a_del
Nov 28 13:59:06 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Deletion of /opt/stack/data/nova/instances/a9a21b61-5815-47ed-adac-040b1fc8e33a_del complete
Nov 28 13:59:06 user nova-compute[75453]: INFO nova.compute.manager [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:59:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:07 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:07 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '794937d9-3c23-41cf-bb74-767e93bc1370' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '794937d9-3c23-41cf-bb74-767e93bc1370' (instance-0000000a)
Nov 28 13:59:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:08 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Took 1.32 seconds to deallocate network for instance.
Nov 28 13:59:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-deleted-a6e94133-9c6d-4d82-a2fe-56e7b65450bb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:08 user nova-compute[75453]: INFO nova.compute.manager [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Neutron deleted interface a6e94133-9c6d-4d82-a2fe-56e7b65450bb; detaching it from the instance and deleting it from the info cache
Nov 28 13:59:08 user nova-compute[75453]: DEBUG nova.network.neutron [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [{"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "address": "fa:16:3e:0c:05:7e", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9daa350f-1a", "ovs_interfaceid": "9daa350f-1a8b-41c9-8fd4-52e99d65b25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-081369c8-e76e-48df-bb9c-ea166e345312 req-a596cad5-f2e4-4839-968d-715aa3067909 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Detach interface failed, port_id=a6e94133-9c6d-4d82-a2fe-56e7b65450bb, reason: Instance 794937d9-3c23-41cf-bb74-767e93bc1370 could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-plugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] Acquiring lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] No waiting events found dispatching network-vif-plugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:08 user nova-compute[75453]: WARNING nova.compute.manager [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received unexpected event network-vif-plugged-885d9ccd-4b72-4063-b89a-ae6a3466a743 for instance with vm_state deleted and task_state None.
Nov 28 13:59:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-b72b55f0-ab80-4dad-98c1-22568971c594 req-8b8e3f0a-2faa-4030-9615-0496f96f6980 service nova] [instance: a9a21b61-5815-47ed-adac-040b1fc8e33a] Received event network-vif-deleted-885d9ccd-4b72-4063-b89a-ae6a3466a743 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:08 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:59:08 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:59:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7666MB free_disk=25.451133728027344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 13:59:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.998s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.224s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:09 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Deleted allocations for instance a9a21b61-5815-47ed-adac-040b1fc8e33a
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 48dd0221-4935-4ee2-9958-90a748fe5255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 949a3612-5042-420f-9911-ec641017d399 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 66c010a7-3604-41c4-9599-d41172a28fe2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 794937d9-3c23-41cf-bb74-767e93bc1370 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 21bca975-80ab-4d17-8a2d-9435c5f9646f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance a51b39c5-001f-4f76-93c0-145fd3373cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ae7cbce3-a3cd-4ea9-99b3-41125062de94 tempest-TaggedAttachmentsTest-1487095452 tempest-TaggedAttachmentsTest-1487095452-project-member] Lock "a9a21b61-5815-47ed-adac-040b1fc8e33a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.781s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:09 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:09 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:09 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b5118c-3e17-4915-9e93-9e5cfe0393b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:59:09 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc503e2-f1c3-4d59-9d1d-c4db678aeef1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1] added
Nov 28 13:59:09 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[884f52c8-e7e5-4416-9ad0-2c2c7e37348c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72b95c7-dbab-4a39-a7bb-9cf69303151c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoMBphND {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoMBphND" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:09 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ec4ce6-7b21-405e-a02a-530124008eb5]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LoMBphND'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[076a313a-c58e-4826-b837-10a6cfb7e5b2]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7d0742-9534-43f9-9986-fd7192671f5c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-deleted-9daa350f-1a8b-41c9-8fd4-52e99d65b25f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:10 user nova-compute[75453]: INFO nova.compute.manager [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Neutron deleted interface 9daa350f-1a8b-41c9-8fd4-52e99d65b25f; detaching it from the instance and deleting it from the info cache
Nov 28 13:59:10 user nova-compute[75453]: DEBUG nova.network.neutron [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [{"id": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "address": "fa:16:3e:db:5a:6b", "network": {"id": "b7880457-5d82-42a8-a9eb-7bd4fe365367", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-8764448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540a415e-6e", "ovs_interfaceid": "540a415e-6e64-4d9f-ba49-ec2a1a85439a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52598d8-eca3-4c39-8642-8231f8189e9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]
Nov 28 13:59:10 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.
Nov 28 13:59:10 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Detach interface failed, port_id=9daa350f-1a8b-41c9-8fd4-52e99d65b25f, reason: Instance 794937d9-3c23-41cf-bb74-767e93bc1370 could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-deleted-540a415e-6e64-4d9f-ba49-ec2a1a85439a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:10 user nova-compute[75453]: INFO nova.compute.manager [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Neutron deleted interface 540a415e-6e64-4d9f-ba49-ec2a1a85439a; detaching it from the instance and deleting it from the info cache
Nov 28 13:59:10 user nova-compute[75453]: DEBUG nova.network.neutron [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [{"id": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "address": "fa:16:3e:78:cb:4c", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91797e6-0b", "ovs_interfaceid": "c91797e6-0bbb-48ea-b5c2-278b0b4319ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "address": "fa:16:3e:dd:0d:ae", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605c90e8-31", "ovs_interfaceid": "605c90e8-31d1-4efa-b5c1-de9f7eeaec51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edf36fdd-4dd8-4465-8669-37b6adf82416", "address": "fa:16:3e:13:a2:41", "network": {"id": "7e1f4582-88e4-4ecd-b385-35a0e8fa5179", "bridge": "br-int", "label": "tempest-device-tagging-net1-57781446", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf36fdd-4d", "ovs_interfaceid": "edf36fdd-4dd8-4465-8669-37b6adf82416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "494d17d8-bf46-4767-852b-4e578ef43377", "address": "fa:16:3e:67:b2:e5", "network": {"id": "8e2471c7-dcf3-42c4-afce-c881d0ad2d8a", "bridge": "br-int", "label": "tempest-device-tagging-net2-449324947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "112860fded124331bc667a597f4c695d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494d17d8-bf", "ovs_interfaceid": "494d17d8-bf46-4767-852b-4e578ef43377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ed3da-78c3-4624-9ed6-c8a6bbb80448]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-136cd4a1-4e26-4ce1-ab08-a39a36e444aa req-56cf3437-a629-48f2-a939-e7fa538a17a3 service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Detach interface failed, port_id=540a415e-6e64-4d9f-ba49-ec2a1a85439a, reason: Instance 794937d9-3c23-41cf-bb74-767e93bc1370 could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ff1b80-b523-4c35-82cd-41a9e915f1c7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:10 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0889e0b-cc5a-47ec-947d-164c9cbc488c]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:10 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Took 4.98 seconds to deallocate network for instance.
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:59:10 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 949a3612-5042-420f-9911-ec641017d399] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23131323833653435', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131323833653435', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.objects.instance [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lazy-loading 'flavor' on Instance uuid 9a32cb51-7b87-4d9b-9e94-72cb60f4371f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 13:59:11 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:59:11 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 13:59:11 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:59:11 user nova-compute[75453]:   <serial>95820667-5de5-45e2-a99e-67643abf1bb1</serial>
Nov 28 13:59:11 user nova-compute[75453]: </disk>
Nov 28 13:59:11 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 949a3612-5042-420f-9911-ec641017d399] Updating instance_info_cache with network_info: [{"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-949a3612-5042-420f-9911-ec641017d399" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 949a3612-5042-420f-9911-ec641017d399] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquired lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'info_cache' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.objects.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:59:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] No VIF found with MAC fa:16:3e:c0:6b:2f, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3c4f1a52-102d-4680-9f23-7c02dac8c069 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.797s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-85f71a1d-9fb6-43d8-a68a-1048f9c50393 req-163c1254-3049-42b1-aab8-a6b754e6c8bb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-deleted-494d17d8-bf46-4767-852b-4e578ef43377 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-85f71a1d-9fb6-43d8-a68a-1048f9c50393 req-163c1254-3049-42b1-aab8-a6b754e6c8bb service nova] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Received event network-vif-deleted-edf36fdd-4dd8-4465-8669-37b6adf82416 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating instance_info_cache with network_info: [{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Releasing lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:59:12 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance destroyed successfully.
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'resources' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.objects.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1751161168',display_name='tempest-AttachVolumeTestJSON-server-1751161168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1751161168',id=2,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw==',key_name='tempest-keypair-605550184',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-hiprfdzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=10e135e2-a52b-437c-adb6-3fb81daf17e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_vif [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56d8de7f-0f, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4692ef2-9eb9-4c16-be0f-5ff470b6e7af) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:12 user nova-compute[75453]: INFO os_vif [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f')
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UODdnTXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:12 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfe9476-5e98-4a86-a130-8747e60be44b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:59:12 user nova-compute[75453]: No targets found.
Nov 28 13:59:12 user nova-compute[75453]: iSNS:
Nov 28 13:59:12 user nova-compute[75453]: No targets found.
Nov 28 13:59:12 user nova-compute[75453]: STATIC:
Nov 28 13:59:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 13:59:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:59:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:59:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867
Nov 28 13:59:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:59:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:12 user nova-compute[75453]: FIRMWARE:
Nov 28 13:59:12 user nova-compute[75453]: No targets found.
Nov 28 13:59:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:59:12 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:59:12 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4582b621-e749-4f99-960c-69d6ef1441a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d57eb4a-308e-4e1f-a68c-5c8fdc50863b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:12 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:12 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:12 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:12 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:12 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:12 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:12 user nova-compute[75453]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:12 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02186ff9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373'): ({'sdh'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Removing single pathed devices sdh {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49bf503-4ac2-43ce-ac30-bed2e30bce79]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[82272a38-869e-49a8-b25c-09db1e0116da]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flushing IO for device /dev/sdh {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc93e088-e849-4bfa-b770-7f88360ff4fd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b73440-345d-4af8-94a1-c1b20bdc5b43]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] SCSI volumes sdh have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d99c031-24f3-4173-aca7-0b092f959a93]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b06666-92fa-4ae4-92a7-5a01e930374e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260]
Nov 28 13:59:12 user nova-compute[75453]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260] successful.
Nov 28 13:59:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c5008e-b448-4b9e-8a7a-2344393bc35e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== disconnect_volume: return (351ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Start _get_guest_xml network_info=[{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5deb5279-8d0e-4325-8772-26ec7b02fe27', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UODdnTXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '10e135e2-a52b-437c-adb6-3fb81daf17e4', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6dd3f41-6624-4976-8316-6d52ce2c4373', 'serial': 'a6dd3f41-6624-4976-8316-6d52ce2c4373'}, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'numa_topology' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.objects.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 13:59:12 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:59:12 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.objects.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UODdnTXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:12 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:12 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:12 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5497fb27-29d0-4ae0-b412-28af77589ac2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:59:12 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9684af33-5031-4444-8f4f-6fab0b815be1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373] added
Nov 28 13:59:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614f1c0-d1b7-423c-9544-413e1b6c8b65]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cb2f98-eea4-45cc-b5df-860fe85a0937]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UODdnTXi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UODdnTXi" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df34b2b-d257-47fb-b955-fa959e9d3fe7]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UODdnTXi'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b01599e-b324-4a2f-a824-640425c29f67]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b38d7-4d84-4297-91bc-50e2793fc4c5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[48722625-d874-4ffe-84ef-1b3de1125942]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260]
Nov 28 13:59:13 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260] successful.
Nov 28 13:59:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bcd3c6-1f19-4630-8415-d2263f51f949]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86516de-548a-466a-8ead-d9ae27e26211]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[14034b9a-7187-4a30-8076-fb8640188b40]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UODdnTXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:59:13 user nova-compute[75453]: INFO nova.compute.manager [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] [instance: 794937d9-3c23-41cf-bb74-767e93bc1370] Took 2.81 seconds to detach 3 volumes for instance.
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:14 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Deleted allocations for instance 794937d9-3c23-41cf-bb74-767e93bc1370
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Stashing vm_state: active {{(pid=75453) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b3f37176-077a-4ca6-a520-b0f1767fe9e3 tempest-TaggedBootDevicesTest_v242-1237344816 tempest-TaggedBootDevicesTest_v242-1237344816-project-member] Lock "794937d9-3c23-41cf-bb74-767e93bc1370" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.108s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '26161343161333761', 'path': '/dev/sdd'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161343161333761', 'path': '/dev/sdd'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1751161168',display_name='tempest-AttachVolumeTestJSON-server-1751161168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1751161168',id=2,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw==',key_name='tempest-keypair-605550184',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-hiprfdzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=10e135e2-a52b-437c-adb6-3fb81daf17e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'pci_devices' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.objects.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:59:14 user nova-compute[75453]:   <uuid>10e135e2-a52b-437c-adb6-3fb81daf17e4</uuid>
Nov 28 13:59:14 user nova-compute[75453]:   <name>instance-00000002</name>
Nov 28 13:59:14 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 13:59:14 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:59:14 user nova-compute[75453]:   <metadata>
Nov 28 13:59:14 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:59:14 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:59:14 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeTestJSON-server-1751161168</nova:name>
Nov 28 13:59:14 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:59:12</nova:creationTime>
Nov 28 13:59:14 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 13:59:14 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 13:59:14 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 13:59:14 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:59:14 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:59:14 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:59:14 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:59:14 user nova-compute[75453]:       <nova:owner>
Nov 28 13:59:14 user nova-compute[75453]:         <nova:user uuid="c38a4b08cd204e2a9b313a7740df3f3e">tempest-AttachVolumeTestJSON-15045878-project-member</nova:user>
Nov 28 13:59:14 user nova-compute[75453]:         <nova:project uuid="56b5137584864cf094d60d14e6f0ab0f">tempest-AttachVolumeTestJSON-15045878</nova:project>
Nov 28 13:59:14 user nova-compute[75453]:       </nova:owner>
Nov 28 13:59:14 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:59:14 user nova-compute[75453]:       <nova:ports>
Nov 28 13:59:14 user nova-compute[75453]:         <nova:port uuid="56d8de7f-0f8a-4f2e-8890-405ec6cb9294">
Nov 28 13:59:14 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 13:59:14 user nova-compute[75453]:         </nova:port>
Nov 28 13:59:14 user nova-compute[75453]:       </nova:ports>
Nov 28 13:59:14 user nova-compute[75453]:     </nova:instance>
Nov 28 13:59:14 user nova-compute[75453]:   </metadata>
Nov 28 13:59:14 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:59:14 user nova-compute[75453]:     <system>
Nov 28 13:59:14 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:59:14 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:59:14 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:59:14 user nova-compute[75453]:       <entry name="serial">10e135e2-a52b-437c-adb6-3fb81daf17e4</entry>
Nov 28 13:59:14 user nova-compute[75453]:       <entry name="uuid">10e135e2-a52b-437c-adb6-3fb81daf17e4</entry>
Nov 28 13:59:14 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:59:14 user nova-compute[75453]:     </system>
Nov 28 13:59:14 user nova-compute[75453]:   </sysinfo>
Nov 28 13:59:14 user nova-compute[75453]:   <os>
Nov 28 13:59:14 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:59:14 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:59:14 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:59:14 user nova-compute[75453]:   </os>
Nov 28 13:59:14 user nova-compute[75453]:   <features>
Nov 28 13:59:14 user nova-compute[75453]:     <acpi/>
Nov 28 13:59:14 user nova-compute[75453]:     <apic/>
Nov 28 13:59:14 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:59:14 user nova-compute[75453]:   </features>
Nov 28 13:59:14 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:59:14 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:59:14 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:59:14 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:59:14 user nova-compute[75453]:   </clock>
Nov 28 13:59:14 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:59:14 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:59:14 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:59:14 user nova-compute[75453]:   </cpu>
Nov 28 13:59:14 user nova-compute[75453]:   <devices>
Nov 28 13:59:14 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:59:14 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:59:14 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk"/>
Nov 28 13:59:14 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:59:14 user nova-compute[75453]:     </disk>
Nov 28 13:59:14 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 13:59:14 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:59:14 user nova-compute[75453]:       <source dev="/dev/sdd"/>
Nov 28 13:59:14 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 13:59:14 user nova-compute[75453]:       <serial>a6dd3f41-6624-4976-8316-6d52ce2c4373</serial>
Nov 28 13:59:14 user nova-compute[75453]:     </disk>
Nov 28 13:59:14 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:59:14 user nova-compute[75453]:       <mac address="fa:16:3e:bd:18:5b"/>
Nov 28 13:59:14 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:59:14 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:59:14 user nova-compute[75453]:       <target dev="tap56d8de7f-0f"/>
Nov 28 13:59:14 user nova-compute[75453]:     </interface>
Nov 28 13:59:14 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:59:14 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/console.log" append="off"/>
Nov 28 13:59:14 user nova-compute[75453]:     </serial>
Nov 28 13:59:14 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:59:14 user nova-compute[75453]:     <video>
Nov 28 13:59:14 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:59:14 user nova-compute[75453]:     </video>
Nov 28 13:59:14 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:59:14 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:59:14 user nova-compute[75453]:     </rng>
Nov 28 13:59:14 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:59:14 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:59:14 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:59:14 user nova-compute[75453]:     </memballoon>
Nov 28 13:59:14 user nova-compute[75453]:   </devices>
Nov 28 13:59:14 user nova-compute[75453]: </domain>
Nov 28 13:59:14 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 13:59:14 user nova-compute[75453]: INFO nova.compute.claims [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Claim successful on node user
Nov 28 13:59:14 user nova-compute[75453]: INFO nova.compute.resource_tracker [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating resource usage from migration 5a7ab958-c206-4dd9-a612-ddf8f4bde9ed
Nov 28 13:59:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'trusted_certs' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.objects.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:59:14 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.201s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.662s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:15 user nova-compute[75453]: INFO nova.compute.manager [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Migrating
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:59:15 user nova-compute[75453]: INFO nova.compute.rpcapi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquired lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Cannot resize image /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'migration_context' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.objects.base [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1751161168',display_name='tempest-AttachVolumeTestJSON-server-1751161168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1751161168',id=2,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw==',key_name='tempest-keypair-605550184',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-hiprfdzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=10e135e2-a52b-437c-adb6-3fb81daf17e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG os_vif [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a205e63-6362-5451-bb4e-c5573b4e2282', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56d8de7f-0f, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56d8de7f-0f, col_values=(('qos', UUID('8bec1848-d3fc-4d57-b06b-3baceb2c4735')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56d8de7f-0f, col_values=(('external_ids', {'iface-id': '56d8de7f-0f8a-4f2e-8890-405ec6cb9294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:18:5b', 'vm-uuid': '10e135e2-a52b-437c-adb6-3fb81daf17e4'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:15 user nova-compute[75453]: INFO os_vif [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f')
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance_info_cache with network_info: [{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Releasing lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Starting migrate_disk_and_power_off {{(pid=75453) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-unplugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-unplugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:16 user nova-compute[75453]: WARNING nova.compute.manager [req-2d7034fc-80d6-4711-913b-501015dc26c0 req-e8fe4db5-1508-4820-b28b-09e9eb5fab23 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-unplugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state active and task_state resize_migrating.
Nov 28 13:59:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance destroyed successfully.
Nov 28 13:59:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-370204766',display_name='tempest-ServerActionsTestOtherB-server-370204766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-370204766',id=3,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg==',key_name='tempest-keypair-2095208703',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d326de84f8224cef95e650bd92e7198f',ramdisk_id='',reservation_id='r-0iqcbio7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1799325713',owner_user_name='tempest-ServerActionsTestOtherB-1799325713-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14da9954e4fc44deb3c603165b10cf66',uuid=9a32cb51-7b87-4d9b-9e94-72cb60f4371f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-888760304-network", "vif_mac": "fa:16:3e:c0:6b:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converting VIF {"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-888760304-network", "vif_mac": "fa:16:3e:c0:6b:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_vif [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36d6817d-5a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f243c4ca-30b5-48b8-b385-0d90c588281d) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:17 user nova-compute[75453]: INFO os_vif [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a')
Nov 28 13:59:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:17 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[89faab2b-61f4-457a-ad2d-c519214af2ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:59:17 user nova-compute[75453]: No targets found.
Nov 28 13:59:17 user nova-compute[75453]: iSNS:
Nov 28 13:59:17 user nova-compute[75453]: No targets found.
Nov 28 13:59:17 user nova-compute[75453]: STATIC:
Nov 28 13:59:17 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 13:59:17 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:17 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:17 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:59:17 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:17 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:17 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:59:17 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:17 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:17 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867
Nov 28 13:59:17 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:17 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:17 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:59:17 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:17 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:17 user nova-compute[75453]: FIRMWARE:
Nov 28 13:59:17 user nova-compute[75453]: No targets found.
Nov 28 13:59:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:59:17 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:59:17 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efbd989-a1bd-485a-ac9c-d6a020353dc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2933fc6a-869a-495a-b0c4-39bd2a8c38dd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:17 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:17 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:17 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:17 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:17 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:17 user nova-compute[75453]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:17 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:17 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0218711ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa4692e-5a58-4d45-a328-021210720d49]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f28ff76-abbf-4e3f-8d04-90cb6c82ed75]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca2c8bd-8e31-43c1-bddc-479758d20c9e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6068c9e0-8048-4817-b154-d7e1926c7f76]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[26717b25-5b60-4e95-a743-096dc8edfdf9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2258327f-30a0-496b-ac5d-c13c8c9af6b5]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]
Nov 28 13:59:17 user nova-compute[75453]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.
Nov 28 13:59:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed05293e-03e9-440c-85c7-c979a9bead97]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] <== disconnect_volume: return (409ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 13:59:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f_resize/disk /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:18 user nova-compute[75453]: WARNING nova.compute.manager [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state active and task_state resize_migrating.
Nov 28 13:59:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:18 user nova-compute[75453]: WARNING nova.compute.manager [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state stopped and task_state powering-on.
Nov 28 13:59:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:18 user nova-compute[75453]: WARNING nova.compute.manager [req-f6efb91a-86c7-4b3b-9aa3-409d362f3ddf req-ab50b936-accc-4b6d-a6e7-422b6457c4e4 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state stopped and task_state powering-on.
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "cp -r /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f_resize/disk /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk" returned: 0 in 0.475s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f_resize/disk.info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk.info {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "cp -r /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f_resize/disk.info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk.info" returned: 0 in 0.037s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:19 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:59:19 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance rebooted successfully.
Nov 28 13:59:19 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6a6560ec-559d-4157-9391-f4ae6241a852 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 13:59:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Port 36d6817d-5a86-4e22-90cd-adfe2b3f176e binding to destination host user is already ACTIVE {{(pid=75453) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 13:59:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:59:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquired lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:59:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG nova.network.neutron [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance_info_cache with network_info: [{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Releasing lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG os_brick.utils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1770a4-f28e-49fb-a80b-c7995bb39e15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ecc7c8-04cb-493e-8863-059c317eb6ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a800e5cf-0184-48dd-a5f1-5bdcbc446a25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0a496a-65c9-4cc2-81e9-208b0c7445c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 13:59:20 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 13:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8d78c0-9bfd-47d6-ae14-e95f3fcfae07]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 13:59:20 user nova-compute[75453]: DEBUG os_brick.utils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received event network-changed-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Refreshing instance network info cache due to event network-changed-f8bff86a-512f-4ff3-97fc-c35d36d68960. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 13:59:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] Acquiring lock "refresh_cache-982e2518-5a29-4c35-b9e1-61e7401a4fd0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 13:59:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] Acquired lock "refresh_cache-982e2518-5a29-4c35-b9e1-61e7401a4fd0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 13:59:21 user nova-compute[75453]: DEBUG nova.network.neutron [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Refreshing network info cache for port f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:22 user nova-compute[75453]: INFO nova.compute.manager [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Terminating instance
Nov 28 13:59:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG nova.network.neutron [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Updated VIF entry in instance network info cache for port f8bff86a-512f-4ff3-97fc-c35d36d68960. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG nova.network.neutron [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Updating instance_info_cache with network_info: [{"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-df906df2-2083-4a4e-a625-a4a4b4fe3edd req-2bc9d47a-6203-4fdb-bbf9-baf9e4cc72a2 service nova] Releasing lock "refresh_cache-982e2518-5a29-4c35-b9e1-61e7401a4fd0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Instance destroyed successfully.
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.objects.instance [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'resources' on Instance uuid 982e2518-5a29-4c35-b9e1-61e7401a4fd0 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-303146235',display_name='tempest-AttachVolumeNegativeTest-server-303146235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-303146235',id=13,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZKtitTlaexaynsP4WYOVlVy18YpeWUi10uTrsxp5Ap02gRbOPB7ajo7zQlg7nEQY/n9BSdbr0uf/IC3pIF4N0iY3+Q3kTObIRV7J9kIk52u+nAsjapNr4dUfTwF11g5A==',key_name='tempest-keypair-1167956881',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-e5b37nad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=982e2518-5a29-4c35-b9e1-61e7401a4fd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "address": "fa:16:3e:fd:30:cb", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bff86a-51", "ovs_interfaceid": "f8bff86a-512f-4ff3-97fc-c35d36d68960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8bff86a-512f-4ff3-97fc-c35d36d68960,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bff86a-51') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG os_vif [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8bff86a-512f-4ff3-97fc-c35d36d68960,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bff86a-51') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8bff86a-51, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7983b16-5fca-4380-b172-bfa8939c34c9) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:23 user nova-compute[75453]: INFO os_vif [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8bff86a-512f-4ff3-97fc-c35d36d68960,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bff86a-51')
Nov 28 13:59:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Deleting instance files /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0_del
Nov 28 13:59:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Deletion of /opt/stack/data/nova/instances/982e2518-5a29-4c35-b9e1-61e7401a4fd0_del complete
Nov 28 13:59:23 user nova-compute[75453]: INFO nova.compute.manager [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 28 13:59:23 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:23 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Took 0.71 seconds to deallocate network for instance.
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-8b0ca870-b647-4be5-b345-ba380e68bb24 req-e93a4597-4e40-4b3a-b2a6-9085fa034053 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received event network-vif-deleted-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received event network-vif-unplugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Acquiring lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] No waiting events found dispatching network-vif-unplugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:23 user nova-compute[75453]: WARNING nova.compute.manager [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received unexpected event network-vif-unplugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance with vm_state deleted and task_state None.
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received event network-vif-plugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Acquiring lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] No waiting events found dispatching network-vif-plugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:23 user nova-compute[75453]: WARNING nova.compute.manager [req-3923d28a-6190-4528-ac65-1d8f57f73648 req-47453cb6-b42d-4fdc-9b00-fd0cb2ffbd94 service nova] [instance: 982e2518-5a29-4c35-b9e1-61e7401a4fd0] Received unexpected event network-vif-plugged-f8bff86a-512f-4ff3-97fc-c35d36d68960 for instance with vm_state deleted and task_state None.
Nov 28 13:59:24 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:59:24 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:59:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:24 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Deleted allocations for instance 982e2518-5a29-4c35-b9e1-61e7401a4fd0
Nov 28 13:59:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d49-576b-4697-950b-00d1ab950300 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "982e2518-5a29-4c35-b9e1-61e7401a4fd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:26 user nova-compute[75453]: INFO nova.compute.manager [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Detaching volume 56478f59-9340-4f10-83f7-bbeee4419867
Nov 28 13:59:26 user nova-compute[75453]: INFO nova.virt.block_device [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Attempting to driver detach volume 56478f59-9340-4f10-83f7-bbeee4419867 from mountpoint /dev/vdb
Nov 28 13:59:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Attempting to detach device vdb from instance 21bca975-80ab-4d17-8a2d-9435c5f9646f from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 13:59:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 13:59:26 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:59:26 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 13:59:26 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:59:26 user nova-compute[75453]:   <serial>56478f59-9340-4f10-83f7-bbeee4419867</serial>
Nov 28 13:59:26 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 13:59:26 user nova-compute[75453]: </disk>
Nov 28 13:59:26 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:59:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Successfully detached device vdb from instance 21bca975-80ab-4d17-8a2d-9435c5f9646f from the persistent domain config.
Nov 28 13:59:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21bca975-80ab-4d17-8a2d-9435c5f9646f from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 13:59:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 13:59:26 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:59:26 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 13:59:26 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 13:59:26 user nova-compute[75453]:   <serial>56478f59-9340-4f10-83f7-bbeee4419867</serial>
Nov 28 13:59:26 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 13:59:26 user nova-compute[75453]: </disk>
Nov 28 13:59:26 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 13:59:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21bca975-80ab-4d17-8a2d-9435c5f9646f {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 13:59:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Starting finish_migration {{(pid=75453) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 13:59:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance directory exists: not creating {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 13:59:28 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Creating image(s)
Nov 28 13:59:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:28 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk. size=21474836480 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 13:59:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk 21474836480 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk 21474836480" returned: 0 in 0.056s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Ensure instance console log exists: /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Start _get_guest_xml network_info=[{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-888760304-network", "vif_mac": "fa:16:3e:c0:6b:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e5df8482-207f-4334-940a-2e193669de95', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9a32cb51-7b87-4d9b-9e94-72cb60f4371f', 'attached_at': '2023-11-28T13:59:29.000000', 'detached_at': '', 'volume_id': '95820667-5de5-45e2-a99e-67643abf1bb1', 'serial': '95820667-5de5-45e2-a99e-67643abf1bb1'}, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 13:59:29 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:59:29 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:29 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d112dfd2-994a-4b6f-91e3-7f32cb804b59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 13:59:29 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefaa9dc-b5d2-4849-9178-e53fed347ba9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1] added
Nov 28 13:59:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2444b8a7-043a-40fc-afdd-6c65db891f9c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f8cf0e-de37-4374-8b68-fe6b8eb0479e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoMBphND {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoMBphND" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e376b-b885-4a41-84a9-553508ad80eb]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LoMBphND'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d4176-77c0-4776-8d51-baabcc2c8b16]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef403175-bca1-4437-a7ab-5edce8d893dd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb8d907-678b-471d-81fa-61cb3be85a77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]
Nov 28 13:59:29 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.
Nov 28 13:59:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff33977-50ee-4f45-b5d6-2db27ef7d564]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0884e7-8576-4a11-9183-a30e16a660ac]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6058855-315e-4464-afc3-8d8c5c843a43]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 13:59:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23131323833653435', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131323833653435', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-370204766',display_name='tempest-ServerActionsTestOtherB-server-370204766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-370204766',id=3,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg==',key_name='tempest-keypair-2095208703',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d326de84f8224cef95e650bd92e7198f',ramdisk_id='',reservation_id='r-0iqcbio7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1799325713',owner_user_name='tempest-ServerActionsTestOtherB-1799325713-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14da9954e4fc44deb3c603165b10cf66',uuid=9a32cb51-7b87-4d9b-9e94-72cb60f4371f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-888760304-network", "vif_mac": "fa:16:3e:c0:6b:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converting VIF {"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-888760304-network", "vif_mac": "fa:16:3e:c0:6b:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 13:59:30 user nova-compute[75453]:   <uuid>9a32cb51-7b87-4d9b-9e94-72cb60f4371f</uuid>
Nov 28 13:59:30 user nova-compute[75453]:   <name>instance-00000003</name>
Nov 28 13:59:30 user nova-compute[75453]:   <memory>2097152</memory>
Nov 28 13:59:30 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 13:59:30 user nova-compute[75453]:   <metadata>
Nov 28 13:59:30 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 13:59:30 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 13:59:30 user nova-compute[75453]:       <nova:name>tempest-ServerActionsTestOtherB-server-370204766</nova:name>
Nov 28 13:59:30 user nova-compute[75453]:       <nova:creationTime>2023-11-28 13:59:29</nova:creationTime>
Nov 28 13:59:30 user nova-compute[75453]:       <nova:flavor name="m1.small">
Nov 28 13:59:30 user nova-compute[75453]:         <nova:memory>2048</nova:memory>
Nov 28 13:59:30 user nova-compute[75453]:         <nova:disk>20</nova:disk>
Nov 28 13:59:30 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 13:59:30 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 13:59:30 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 13:59:30 user nova-compute[75453]:       </nova:flavor>
Nov 28 13:59:30 user nova-compute[75453]:       <nova:owner>
Nov 28 13:59:30 user nova-compute[75453]:         <nova:user uuid="14da9954e4fc44deb3c603165b10cf66">tempest-ServerActionsTestOtherB-1799325713-project-member</nova:user>
Nov 28 13:59:30 user nova-compute[75453]:         <nova:project uuid="d326de84f8224cef95e650bd92e7198f">tempest-ServerActionsTestOtherB-1799325713</nova:project>
Nov 28 13:59:30 user nova-compute[75453]:       </nova:owner>
Nov 28 13:59:30 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 13:59:30 user nova-compute[75453]:       <nova:ports>
Nov 28 13:59:30 user nova-compute[75453]:         <nova:port uuid="36d6817d-5a86-4e22-90cd-adfe2b3f176e">
Nov 28 13:59:30 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 13:59:30 user nova-compute[75453]:         </nova:port>
Nov 28 13:59:30 user nova-compute[75453]:       </nova:ports>
Nov 28 13:59:30 user nova-compute[75453]:     </nova:instance>
Nov 28 13:59:30 user nova-compute[75453]:   </metadata>
Nov 28 13:59:30 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 13:59:30 user nova-compute[75453]:     <system>
Nov 28 13:59:30 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 13:59:30 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 13:59:30 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 13:59:30 user nova-compute[75453]:       <entry name="serial">9a32cb51-7b87-4d9b-9e94-72cb60f4371f</entry>
Nov 28 13:59:30 user nova-compute[75453]:       <entry name="uuid">9a32cb51-7b87-4d9b-9e94-72cb60f4371f</entry>
Nov 28 13:59:30 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 13:59:30 user nova-compute[75453]:     </system>
Nov 28 13:59:30 user nova-compute[75453]:   </sysinfo>
Nov 28 13:59:30 user nova-compute[75453]:   <os>
Nov 28 13:59:30 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 13:59:30 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 13:59:30 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 13:59:30 user nova-compute[75453]:   </os>
Nov 28 13:59:30 user nova-compute[75453]:   <features>
Nov 28 13:59:30 user nova-compute[75453]:     <acpi/>
Nov 28 13:59:30 user nova-compute[75453]:     <apic/>
Nov 28 13:59:30 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 13:59:30 user nova-compute[75453]:   </features>
Nov 28 13:59:30 user nova-compute[75453]:   <clock offset="utc">
Nov 28 13:59:30 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 13:59:30 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 13:59:30 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 13:59:30 user nova-compute[75453]:   </clock>
Nov 28 13:59:30 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 13:59:30 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 13:59:30 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 13:59:30 user nova-compute[75453]:   </cpu>
Nov 28 13:59:30 user nova-compute[75453]:   <devices>
Nov 28 13:59:30 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 13:59:30 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 13:59:30 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk"/>
Nov 28 13:59:30 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 13:59:30 user nova-compute[75453]:     </disk>
Nov 28 13:59:30 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 13:59:30 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 13:59:30 user nova-compute[75453]:       <source dev="/dev/sdc"/>
Nov 28 13:59:30 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 13:59:30 user nova-compute[75453]:       <serial>95820667-5de5-45e2-a99e-67643abf1bb1</serial>
Nov 28 13:59:30 user nova-compute[75453]:     </disk>
Nov 28 13:59:30 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 13:59:30 user nova-compute[75453]:       <mac address="fa:16:3e:c0:6b:2f"/>
Nov 28 13:59:30 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:59:30 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 13:59:30 user nova-compute[75453]:       <target dev="tap36d6817d-5a"/>
Nov 28 13:59:30 user nova-compute[75453]:     </interface>
Nov 28 13:59:30 user nova-compute[75453]:     <serial type="pty">
Nov 28 13:59:30 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/console.log" append="off"/>
Nov 28 13:59:30 user nova-compute[75453]:     </serial>
Nov 28 13:59:30 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 13:59:30 user nova-compute[75453]:     <video>
Nov 28 13:59:30 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 13:59:30 user nova-compute[75453]:     </video>
Nov 28 13:59:30 user nova-compute[75453]:     <rng model="virtio">
Nov 28 13:59:30 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 13:59:30 user nova-compute[75453]:     </rng>
Nov 28 13:59:30 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 13:59:30 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 13:59:30 user nova-compute[75453]:       <stats period="10"/>
Nov 28 13:59:30 user nova-compute[75453]:     </memballoon>
Nov 28 13:59:30 user nova-compute[75453]:   </devices>
Nov 28 13:59:30 user nova-compute[75453]: </domain>
Nov 28 13:59:30 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-370204766',display_name='tempest-ServerActionsTestOtherB-server-370204766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-370204766',id=3,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg==',key_name='tempest-keypair-2095208703',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d326de84f8224cef95e650bd92e7198f',ramdisk_id='',reservation_id='r-0iqcbio7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1799325713',owner_user_name='tempest-ServerActionsTestOtherB-1799325713-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T13:59:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14da9954e4fc44deb3c603165b10cf66',uuid=9a32cb51-7b87-4d9b-9e94-72cb60f4371f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-888760304-network", "vif_mac": "fa:16:3e:c0:6b:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converting VIF {"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-888760304-network", "vif_mac": "fa:16:3e:c0:6b:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG os_vif [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16449ee4-b347-5841-87ae-acfdb3982287', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36d6817d-5a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36d6817d-5a, col_values=(('qos', UUID('ef2e99b9-2895-4118-80ae-0ff3eaab206d')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36d6817d-5a, col_values=(('external_ids', {'iface-id': '36d6817d-5a86-4e22-90cd-adfe2b3f176e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:6b:2f', 'vm-uuid': '9a32cb51-7b87-4d9b-9e94-72cb60f4371f'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:30 user nova-compute[75453]: INFO os_vif [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a')
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 13:59:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] No VIF found with MAC fa:16:3e:c0:6b:2f, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 13:59:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:33 user nova-compute[75453]: WARNING nova.compute.manager [req-c3f12258-c55f-435f-9ba8-bbe8d9a48183 req-6faa1a3a-bff3-410f-a4b2-6fc24ce6d09b service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state active and task_state resize_finish.
Nov 28 13:59:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 13:59:34 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance running successfully.
Nov 28 13:59:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Failed to set time: agent not configured {{(pid=75453) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 13:59:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-884a2ee5-7532-47c0-9425-39678597d310 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] finish_migration finished successfully. {{(pid=75453) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 13:59:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:35 user nova-compute[75453]: WARNING nova.compute.manager [req-8a5ba61e-2f24-4f28-89f4-0bd1907120b1 req-be5f4bce-0aeb-420b-bc00-4fd088fd096f service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state resized and task_state None.
Nov 28 13:59:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:46 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 21bca975-80ab-4d17-8a2d-9435c5f9646f is timed out.
Nov 28 13:59:46 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Successfully detached device vdb from instance 21bca975-80ab-4d17-8a2d-9435c5f9646f from the live domain config.
Nov 28 13:59:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuaMbehG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:46 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e817e-f1c0-4dbe-9bd6-223717be24b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:59:46 user nova-compute[75453]: No targets found.
Nov 28 13:59:46 user nova-compute[75453]: iSNS:
Nov 28 13:59:46 user nova-compute[75453]: No targets found.
Nov 28 13:59:46 user nova-compute[75453]: STATIC:
Nov 28 13:59:46 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 13:59:46 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:46 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:46 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:59:46 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:46 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:46 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:59:46 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:46 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:46 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867
Nov 28 13:59:46 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:46 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:46 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:59:46 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:46 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:46 user nova-compute[75453]: FIRMWARE:
Nov 28 13:59:46 user nova-compute[75453]: No targets found.
Nov 28 13:59:46 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:59:46 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:59:46 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaf54fb-9f20-469c-bc81-ecba62e28522]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71e92a9-c352-45c2-b8e7-734a27e36220]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:46 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:46 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:46 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:46 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:46 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:46 user nova-compute[75453]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 (non-flash)
Nov 28 13:59:46 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:46 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:46 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:46 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c726710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.050s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabfcad4-d0c7-48ff-be4c-b8528d75e7d6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.041s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[54730445-f898-46fa-9889-05887d6f97f5]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4d6fb8-1bb2-4a11-8561-45366445e2b1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 13:59:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f06ade-37b5-4a9d-899c-03cb85a74860]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb2ebc9-6e53-4b18-8a67-a4b10fb62783]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd55183-4f9f-4905-88f6-6127f540e90b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867, portal: 172.16.0.220,3260]
Nov 28 13:59:47 user nova-compute[75453]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867, portal: 172.16.0.220,3260] successful.
Nov 28 13:59:47 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4666fa6-d7e8-47f7-94a4-3792731e97da]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] <== disconnect_volume: return (442ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'flavor' on Instance uuid 21bca975-80ab-4d17-8a2d-9435c5f9646f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c7e2b357-6db9-4b3d-a6c7-ff053bef71bb tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.107s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.887s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:48 user nova-compute[75453]: INFO nova.compute.manager [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Terminating instance
Nov 28 13:59:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received event network-vif-unplugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] No waiting events found dispatching network-vif-unplugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-5126c553-2842-41fe-9c15-649fc36b74d6 req-7187db27-f66f-464d-a166-ed05f673523e service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received event network-vif-unplugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Instance destroyed successfully.
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.objects.instance [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'resources' on Instance uuid 21bca975-80ab-4d17-8a2d-9435c5f9646f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1509611543',display_name='tempest-VolumesSnapshotTestJSON-instance-1509611543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1509611543',id=11,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEZcduiQ4Bg+SyAMn1YHq4xZH858Iy0RGGFa+eLBzBoZOCJYpecnguM8KrxCXYdoPpgbGSlntpvAvtlnQy48NNkpQqMwqeZODnZhOhQ9HS/mZfIvCp+Xx38biZYtIPHOA==',key_name='tempest-keypair-1571158505',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:57:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff4bdacb213b463cb88e3d046e931b9d',ramdisk_id='',reservation_id='r-q6pciizc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-766520769',owner_user_name='tempest-VolumesSnapshotTestJSON-766520769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:57:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='570ac6978fc249ba93d39e40d5d7eac7',uuid=21bca975-80ab-4d17-8a2d-9435c5f9646f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converting VIF {"id": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "address": "fa:16:3e:e5:c4:27", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1543b940-0c", "ovs_interfaceid": "1543b940-0c84-4e66-b424-f3c6fbd8c737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=1543b940-0c84-4e66-b424-f3c6fbd8c737,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1543b940-0c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_vif [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=1543b940-0c84-4e66-b424-f3c6fbd8c737,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1543b940-0c') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1543b940-0c, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9392916-5d39-4fd1-b577-9b8746f28ed5) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:49 user nova-compute[75453]: INFO os_vif [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c4:27,bridge_name='br-int',has_traffic_filtering=True,id=1543b940-0c84-4e66-b424-f3c6fbd8c737,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1543b940-0c')
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuaMbehG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 13:59:49 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1f7b2-f84f-4e09-b405-f8010870231f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 13:59:49 user nova-compute[75453]: No targets found.
Nov 28 13:59:49 user nova-compute[75453]: iSNS:
Nov 28 13:59:49 user nova-compute[75453]: No targets found.
Nov 28 13:59:49 user nova-compute[75453]: STATIC:
Nov 28 13:59:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 13:59:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 13:59:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 13:59:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 13:59:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 13:59:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 13:59:49 user nova-compute[75453]: FIRMWARE:
Nov 28 13:59:49 user nova-compute[75453]: No targets found.
Nov 28 13:59:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 13:59:49 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 13:59:49 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56478f59-9340-4f10-83f7-bbeee4419867', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0324ae-4d7f-49bf-a7c9-80b126fa33ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[70062b04-d3d3-4253-b93c-f607e5fcbaf5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:49 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:49 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:49 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 13:59:49 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 13:59:49 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 13:59:49 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 13:59:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c727490>, {}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Disconnecting from: [] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.102s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] <== disconnect_volume: return (102ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 13:59:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Deleting instance files /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f_del
Nov 28 13:59:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Deletion of /opt/stack/data/nova/instances/21bca975-80ab-4d17-8a2d-9435c5f9646f_del complete
Nov 28 13:59:49 user nova-compute[75453]: INFO nova.compute.manager [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 28 13:59:49 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received event network-vif-deleted-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:49 user nova-compute[75453]: INFO nova.compute.manager [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Neutron deleted interface 1543b940-0c84-4e66-b424-f3c6fbd8c737; detaching it from the instance and deleting it from the info cache
Nov 28 13:59:49 user nova-compute[75453]: DEBUG nova.network.neutron [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 13:59:49 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Took 0.74 seconds to deallocate network for instance.
Nov 28 13:59:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-fb8b8260-5e44-4545-8f35-f41780ada9ac req-6b8376e1-0dba-4a33-9e2d-d424983eee4a service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Detach interface failed, port_id=1543b940-0c84-4e66-b424-f3c6fbd8c737, reason: Instance 21bca975-80ab-4d17-8a2d-9435c5f9646f could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 13:59:50 user nova-compute[75453]: WARNING nova.volume.cinder [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Attachment 5142f3c1-8040-4277-868f-7b36a1afa8be does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5142f3c1-8040-4277-868f-7b36a1afa8be. (HTTP 404) (Request-ID: req-e2095622-28af-436a-bfd7-80cb6c45c7a0)
Nov 28 13:59:50 user nova-compute[75453]: INFO nova.compute.manager [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 13:59:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:50 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 13:59:50 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 13:59:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:50 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Deleted allocations for instance 21bca975-80ab-4d17-8a2d-9435c5f9646f
Nov 28 13:59:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-73b93831-0046-4a24-9a29-d6deb69c7823 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.346s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received event network-vif-plugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 13:59:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] Acquiring lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 13:59:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 13:59:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] Lock "21bca975-80ab-4d17-8a2d-9435c5f9646f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 13:59:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] No waiting events found dispatching network-vif-plugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 13:59:50 user nova-compute[75453]: WARNING nova.compute.manager [req-b08b9416-7038-4c55-9303-61b6647bd7a2 req-3a75f54d-4855-4d75-ab4e-5599356050c4 service nova] [instance: 21bca975-80ab-4d17-8a2d-9435c5f9646f] Received unexpected event network-vif-plugged-1543b940-0c84-4e66-b424-f3c6fbd8c737 for instance with vm_state deleted and task_state None.
Nov 28 13:59:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 13:59:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:00:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:00:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:00:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:00:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:07 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:07 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7908MB free_disk=25.491050720214844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Applying migration context for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f as it has an incoming, in-progress migration 5a7ab958-c206-4dd9-a612-ddf8f4bde9ed. Migration status is finished {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 14:00:07 user nova-compute[75453]: INFO nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating resource usage from migration 5a7ab958-c206-4dd9-a612-ddf8f4bde9ed
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 48dd0221-4935-4ee2-9958-90a748fe5255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 949a3612-5042-420f-9911-ec641017d399 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 66c010a7-3604-41c4-9599-d41172a28fe2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance a51b39c5-001f-4f76-93c0-145fd3373cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Migration 5a7ab958-c206-4dd9-a612-ddf8f4bde9ed is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:00:07 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:00:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:00:08 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:00:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:00:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:00:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:00:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:00:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:00:09 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Updating instance_info_cache with network_info: [{"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-3907babd-71af-4fca-8ad7-4a7dae1710d6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:00:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "949a3612-5042-420f-9911-ec641017d399" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:14 user nova-compute[75453]: INFO nova.compute.manager [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Detaching volume ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 14:00:15 user nova-compute[75453]: INFO nova.virt.block_device [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Attempting to driver detach volume ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 from mountpoint /dev/vdb
Nov 28 14:00:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Attempting to detach device vdb from instance 949a3612-5042-420f-9911-ec641017d399 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:00:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:00:15 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:00:15 user nova-compute[75453]:   <source dev="/dev/sdi"/>
Nov 28 14:00:15 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:00:15 user nova-compute[75453]:   <serial>ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6</serial>
Nov 28 14:00:15 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:00:15 user nova-compute[75453]: </disk>
Nov 28 14:00:15 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:00:15 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully detached device vdb from instance 949a3612-5042-420f-9911-ec641017d399 from the persistent domain config.
Nov 28 14:00:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 949a3612-5042-420f-9911-ec641017d399 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:00:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:00:15 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:00:15 user nova-compute[75453]:   <source dev="/dev/sdi"/>
Nov 28 14:00:15 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:00:15 user nova-compute[75453]:   <serial>ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6</serial>
Nov 28 14:00:15 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:00:15 user nova-compute[75453]: </disk>
Nov 28 14:00:15 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:00:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 949a3612-5042-420f-9911-ec641017d399 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:00:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "a51b39c5-001f-4f76-93c0-145fd3373cc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "a51b39c5-001f-4f76-93c0-145fd3373cc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:21 user nova-compute[75453]: INFO nova.compute.manager [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Terminating instance
Nov 28 14:00:21 user nova-compute[75453]: DEBUG nova.compute.manager [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:21 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Instance destroyed successfully.
Nov 28 14:00:21 user nova-compute[75453]: DEBUG nova.objects.instance [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lazy-loading 'resources' on Instance uuid a51b39c5-001f-4f76-93c0-145fd3373cc2 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:58:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1594648075',display_name='tempest-VolumesAdminNegativeTest-server-1594648075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1594648075',id=14,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75b572682eb94af0b628ee30a16d9225',ramdisk_id='',reservation_id='r-kir3mubv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-963761222',owner_user_name='tempest-VolumesAdminNegativeTest-963761222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:58:31Z,user_data=None,user_id='c9f9b1cc04a4417ebf987aa99a18e6a7',uuid=a51b39c5-001f-4f76-93c0-145fd3373cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converting VIF {"id": "70e39897-4a33-4d71-a525-84ce5c721830", "address": "fa:16:3e:2b:a1:df", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70e39897-4a", "ovs_interfaceid": "70e39897-4a33-4d71-a525-84ce5c721830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a1:df,bridge_name='br-int',has_traffic_filtering=True,id=70e39897-4a33-4d71-a525-84ce5c721830,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e39897-4a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG os_vif [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a1:df,bridge_name='br-int',has_traffic_filtering=True,id=70e39897-4a33-4d71-a525-84ce5c721830,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e39897-4a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70e39897-4a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6f16527-ebd8-4b80-84b0-38149418358a) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:00:21 user nova-compute[75453]: INFO os_vif [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a1:df,bridge_name='br-int',has_traffic_filtering=True,id=70e39897-4a33-4d71-a525-84ce5c721830,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70e39897-4a')
Nov 28 14:00:21 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Deleting instance files /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2_del
Nov 28 14:00:21 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Deletion of /opt/stack/data/nova/instances/a51b39c5-001f-4f76-93c0-145fd3373cc2_del complete
Nov 28 14:00:22 user nova-compute[75453]: INFO nova.compute.manager [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 28 14:00:22 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:00:22 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:00:22 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:00:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:22 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:22 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Took 0.57 seconds to deallocate network for instance.
Nov 28 14:00:22 user nova-compute[75453]: DEBUG nova.compute.manager [req-4952a6f9-66c1-4d0e-8c91-50c34474f10f req-f2d0b0a4-06eb-4c2e-90c7-e73def48fb59 service nova] [instance: a51b39c5-001f-4f76-93c0-145fd3373cc2] Received event network-vif-deleted-70e39897-4a33-4d71-a525-84ce5c721830 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.035s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:00:23 user nova-compute[75453]: INFO nova.compute.claims [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Claim successful on node user
Nov 28 14:00:23 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Deleted allocations for instance a51b39c5-001f-4f76-93c0-145fd3373cc2
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cf9737c2-3690-47f3-8e7a-982fb585327f tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "a51b39c5-001f-4f76-93c0-145fd3373cc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.065s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:00:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.policy [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bda47eaf5e34007aacf101594a9a158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b30ed6146c4a7f82b357d83df9e88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:00:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Creating image(s)
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "/opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "/opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "33747d099d4a9fc707d67adeecd9b116444d0eb3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "33747d099d4a9fc707d67adeecd9b116444d0eb3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:24 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Successfully created port: e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:00:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:24 user nova-compute[75453]: DEBUG nova.virt.images [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 4c805d98-1957-42b5-99d6-f6b4807c6557 was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 14:00:24 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:00:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3.part /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3.part /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3.converted" returned: 0 in 0.367s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "33747d099d4a9fc707d67adeecd9b116444d0eb3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.540s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3 --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "33747d099d4a9fc707d67adeecd9b116444d0eb3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "33747d099d4a9fc707d67adeecd9b116444d0eb3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3 --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3,backing_fmt=raw /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3,backing_fmt=raw /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk 1073741824" returned: 0 in 0.067s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "33747d099d4a9fc707d67adeecd9b116444d0eb3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3 --force-share --output=json" returned: 0 in 0.216s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Cannot resize image /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Ensure instance console log exists: /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Successfully updated port: e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "refresh_cache-1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquired lock "refresh_cache-1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received event network-changed-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Refreshing instance network info cache due to event network-changed-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] Acquiring lock "refresh_cache-1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Updating instance_info_cache with network_info: [{"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Releasing lock "refresh_cache-1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Instance network_info: |[{"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] Acquired lock "refresh_cache-1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Refreshing network info cache for port e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Start _get_guest_xml network_info=[{"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T14:00:15Z,direct_url=<?>,disk_format='qcow2',id=4c805d98-1957-42b5-99d6-f6b4807c6557,min_disk=0,min_ram=0,name='',owner='de997c7a917146fda650ea880938e5ce',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T14:00:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'scsi', 'encrypted': False, 'image_id': '4c805d98-1957-42b5-99d6-f6b4807c6557'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:00:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T14:00:15Z,direct_url=<?>,disk_format='qcow2',id=4c805d98-1957-42b5-99d6-f6b4807c6557,min_disk=0,min_ram=0,name='',owner='de997c7a917146fda650ea880938e5ce',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T14:00:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T14:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1717889095',display_name='tempest-AttachSCSIVolumeTestJSON-server-1717889095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1717889095',id=15,image_ref='4c805d98-1957-42b5-99d6-f6b4807c6557',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLdh5KkZs2uRczkjfWNP8lhnjvPNkrz2kWYuh21IhX5LJ6HVeqLmAMoelvP7qtY4O1o8zNE86kmj07w3j5Qds7nQiYacJk1xc9F2fBooepoKUgkZbjcARaG+b/u9MMGIw==',key_name='tempest-keypair-601378316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b30ed6146c4a7f82b357d83df9e88b',ramdisk_id='',reservation_id='r-sqhh50yh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4c805d98-1957-42b5-99d6-f6b4807c6557',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-618513649',owner_user_name='tempest-AttachSCSIVolumeTestJSON-618513649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bda47eaf5e34007aacf101594a9a158',uuid=1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Converting VIF {"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5,network=Network(5e9f6cb3-94c3-4518-9eba-ec555278d020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0cece8e-db') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:00:27 user nova-compute[75453]:   <uuid>1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d</uuid>
Nov 28 14:00:27 user nova-compute[75453]:   <name>instance-0000000f</name>
Nov 28 14:00:27 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:00:27 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:00:27 user nova-compute[75453]:   <metadata>
Nov 28 14:00:27 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:00:27 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:00:27 user nova-compute[75453]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1717889095</nova:name>
Nov 28 14:00:27 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:00:27</nova:creationTime>
Nov 28 14:00:27 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:00:27 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:00:27 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:00:27 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:00:27 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:00:27 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:00:27 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:00:27 user nova-compute[75453]:       <nova:owner>
Nov 28 14:00:27 user nova-compute[75453]:         <nova:user uuid="1bda47eaf5e34007aacf101594a9a158">tempest-AttachSCSIVolumeTestJSON-618513649-project-member</nova:user>
Nov 28 14:00:27 user nova-compute[75453]:         <nova:project uuid="24b30ed6146c4a7f82b357d83df9e88b">tempest-AttachSCSIVolumeTestJSON-618513649</nova:project>
Nov 28 14:00:27 user nova-compute[75453]:       </nova:owner>
Nov 28 14:00:27 user nova-compute[75453]:       <nova:root type="image" uuid="4c805d98-1957-42b5-99d6-f6b4807c6557"/>
Nov 28 14:00:27 user nova-compute[75453]:       <nova:ports>
Nov 28 14:00:27 user nova-compute[75453]:         <nova:port uuid="e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5">
Nov 28 14:00:27 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 14:00:27 user nova-compute[75453]:         </nova:port>
Nov 28 14:00:27 user nova-compute[75453]:       </nova:ports>
Nov 28 14:00:27 user nova-compute[75453]:     </nova:instance>
Nov 28 14:00:27 user nova-compute[75453]:   </metadata>
Nov 28 14:00:27 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:00:27 user nova-compute[75453]:     <system>
Nov 28 14:00:27 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:00:27 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:00:27 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:00:27 user nova-compute[75453]:       <entry name="serial">1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d</entry>
Nov 28 14:00:27 user nova-compute[75453]:       <entry name="uuid">1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d</entry>
Nov 28 14:00:27 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:00:27 user nova-compute[75453]:     </system>
Nov 28 14:00:27 user nova-compute[75453]:   </sysinfo>
Nov 28 14:00:27 user nova-compute[75453]:   <os>
Nov 28 14:00:27 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:00:27 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:00:27 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:00:27 user nova-compute[75453]:   </os>
Nov 28 14:00:27 user nova-compute[75453]:   <features>
Nov 28 14:00:27 user nova-compute[75453]:     <acpi/>
Nov 28 14:00:27 user nova-compute[75453]:     <apic/>
Nov 28 14:00:27 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:00:27 user nova-compute[75453]:   </features>
Nov 28 14:00:27 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:00:27 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:00:27 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:00:27 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:00:27 user nova-compute[75453]:   </clock>
Nov 28 14:00:27 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:00:27 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:00:27 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:00:27 user nova-compute[75453]:   </cpu>
Nov 28 14:00:27 user nova-compute[75453]:   <devices>
Nov 28 14:00:27 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:00:27 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:00:27 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk"/>
Nov 28 14:00:27 user nova-compute[75453]:       <target dev="sda" bus="scsi"/>
Nov 28 14:00:27 user nova-compute[75453]:       <address type="drive" controller="0" unit="0"/>
Nov 28 14:00:27 user nova-compute[75453]:     </disk>
Nov 28 14:00:27 user nova-compute[75453]:     <disk type="file" device="cdrom">
Nov 28 14:00:27 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 14:00:27 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk.config"/>
Nov 28 14:00:27 user nova-compute[75453]:       <target dev="sdb" bus="scsi"/>
Nov 28 14:00:27 user nova-compute[75453]:       <address type="drive" controller="0" unit="1"/>
Nov 28 14:00:27 user nova-compute[75453]:     </disk>
Nov 28 14:00:27 user nova-compute[75453]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 28 14:00:27 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:00:27 user nova-compute[75453]:       <mac address="fa:16:3e:de:ec:0f"/>
Nov 28 14:00:27 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:00:27 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:00:27 user nova-compute[75453]:       <target dev="tape0cece8e-db"/>
Nov 28 14:00:27 user nova-compute[75453]:     </interface>
Nov 28 14:00:27 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:00:27 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/console.log" append="off"/>
Nov 28 14:00:27 user nova-compute[75453]:     </serial>
Nov 28 14:00:27 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:00:27 user nova-compute[75453]:     <video>
Nov 28 14:00:27 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:00:27 user nova-compute[75453]:     </video>
Nov 28 14:00:27 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:00:27 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:00:27 user nova-compute[75453]:     </rng>
Nov 28 14:00:27 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:00:27 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:00:27 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:00:27 user nova-compute[75453]:     </memballoon>
Nov 28 14:00:27 user nova-compute[75453]:   </devices>
Nov 28 14:00:27 user nova-compute[75453]: </domain>
Nov 28 14:00:27 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T14:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1717889095',display_name='tempest-AttachSCSIVolumeTestJSON-server-1717889095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1717889095',id=15,image_ref='4c805d98-1957-42b5-99d6-f6b4807c6557',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLdh5KkZs2uRczkjfWNP8lhnjvPNkrz2kWYuh21IhX5LJ6HVeqLmAMoelvP7qtY4O1o8zNE86kmj07w3j5Qds7nQiYacJk1xc9F2fBooepoKUgkZbjcARaG+b/u9MMGIw==',key_name='tempest-keypair-601378316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24b30ed6146c4a7f82b357d83df9e88b',ramdisk_id='',reservation_id='r-sqhh50yh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4c805d98-1957-42b5-99d6-f6b4807c6557',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-618513649',owner_user_name='tempest-AttachSCSIVolumeTestJSON-618513649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bda47eaf5e34007aacf101594a9a158',uuid=1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Converting VIF {"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5,network=Network(5e9f6cb3-94c3-4518-9eba-ec555278d020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0cece8e-db') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG os_vif [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5,network=Network(5e9f6cb3-94c3-4518-9eba-ec555278d020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0cece8e-db') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a5fc904-39e6-54a0-9821-00d9d0e4dafc', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0cece8e-db, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0cece8e-db, col_values=(('qos', UUID('1f9108a9-aed1-496a-b6b8-877a452fd454')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0cece8e-db, col_values=(('external_ids', {'iface-id': 'e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:ec:0f', 'vm-uuid': '1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:27 user nova-compute[75453]: INFO os_vif [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5,network=Network(5e9f6cb3-94c3-4518-9eba-ec555278d020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0cece8e-db')
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] No BDM found with device name sda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:00:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] No VIF found with MAC fa:16:3e:de:ec:0f, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:00:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Using config drive
Nov 28 14:00:28 user nova-compute[75453]: DEBUG nova.network.neutron [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Updated VIF entry in instance network info cache for port e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:00:28 user nova-compute[75453]: DEBUG nova.network.neutron [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Updating instance_info_cache with network_info: [{"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ca1094cf-d6a2-4899-96f7-a93e648182d4 req-a0b59563-356a-42fa-ab93-fa608b93047b service nova] Releasing lock "refresh_cache-1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:00:28 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Creating config drive at /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk.config
Nov 28 14:00:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp_blryk_ {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp_blryk_" returned: 0 in 0.071s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received event network-vif-plugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] No waiting events found dispatching network-vif-plugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:00:30 user nova-compute[75453]: WARNING nova.compute.manager [req-95e5bb0e-b8a0-44db-ba6b-7fa382fbba5f req-76f422da-5c84-46bc-8ac6-deb3ba550d9f service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received unexpected event network-vif-plugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance with vm_state building and task_state spawning.
Nov 28 14:00:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received event network-vif-plugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] No waiting events found dispatching network-vif-plugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:00:32 user nova-compute[75453]: WARNING nova.compute.manager [req-5e2e19d5-7774-4004-93a1-820fc1002517 req-d457b6c3-dbe7-49ec-bbe3-d596d0ead56f service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received unexpected event network-vif-plugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance with vm_state building and task_state spawning.
Nov 28 14:00:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:00:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:00:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Instance spawned successfully.
Nov 28 14:00:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:00:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:33 user nova-compute[75453]: INFO nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Took 9.23 seconds to spawn the instance on the hypervisor.
Nov 28 14:00:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:00:33 user nova-compute[75453]: INFO nova.compute.manager [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Took 10.22 seconds to build instance.
Nov 28 14:00:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d6c97801-4aa4-42c9-af3f-aeba9f480b10 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.388s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 949a3612-5042-420f-9911-ec641017d399 is timed out.
Nov 28 14:00:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully detached device vdb from instance 949a3612-5042-420f-9911-ec641017d399 from the live domain config.
Nov 28 14:00:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUPHafOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:00:35 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c4ac1c-8bbd-456a-96e7-93609cc8aed2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:00:35 user nova-compute[75453]: No targets found.
Nov 28 14:00:35 user nova-compute[75453]: iSNS:
Nov 28 14:00:35 user nova-compute[75453]: No targets found.
Nov 28 14:00:35 user nova-compute[75453]: STATIC:
Nov 28 14:00:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:00:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:00:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:00:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 14:00:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:00:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:00:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6
Nov 28 14:00:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:00:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:00:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 14:00:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:00:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:00:35 user nova-compute[75453]: FIRMWARE:
Nov 28 14:00:35 user nova-compute[75453]: No targets found.
Nov 28 14:00:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:00:35 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:00:35 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[87388b74-f4d1-4336-a718-f1aa1093113f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36b7f5c-c405-4313-a4d2-5a6ae0c31523]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:00:35 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:00:35 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:00:35 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 14:00:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:00:35 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:00:35 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:00:35 user nova-compute[75453]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 (non-flash)
Nov 28 14:00:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c1f5a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6'): ({'sdi'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Removing single pathed devices sdi {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a5e7f3-d3d0-44de-b54c-253444cfa727]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4182f2f-72b0-4a15-aba5-8eaf8a034b7e]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flushing IO for device /dev/sdi {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac8aab-443b-4c9b-87b2-3e486c792e8e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a6d692-bff4-44cf-ab8a-5493915c6a94]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] SCSI volumes sdi have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f74ceb-4049-49a2-88e7-0b7f4e54884b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[770e17cc-fd21-4ef3-b900-8248abcbda33]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6, portal: 172.16.0.220,3260]
Nov 28 14:00:35 user nova-compute[75453]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6, portal: 172.16.0.220,3260] successful.
Nov 28 14:00:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1a5b57-ff5e-4a1a-9d29-c57642bfd2f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae5f035-30e8-46ed-aeda-1ef8991d26c9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] <== disconnect_volume: return (400ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:00:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:00:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:36 user nova-compute[75453]: DEBUG nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:00:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:36 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:00:36 user nova-compute[75453]: INFO nova.compute.claims [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Claim successful on node user
Nov 28 14:00:36 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:00:36 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG nova.network.neutron [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG nova.objects.instance [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'flavor' on Instance uuid 949a3612-5042-420f-9911-ec641017d399 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:00:37 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:00:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-09d037fd-6b0c-4c4d-ae81-2543a261e808 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.330s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG nova.policy [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:00:37 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Creating image(s)
Nov 28 14:00:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "/opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "/opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "871f9a979040f0a7b889bc428222cc58c45dfd71" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "871f9a979040f0a7b889bc428222cc58c45dfd71" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71.part --force-share --output=json" returned: 0 in 0.232s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG nova.virt.images [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 13624d8f-7316-4efc-8993-8da1904872d5 was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71.part /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG nova.network.neutron [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Successfully created port: 43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71.part /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71.converted" returned: 0 in 0.166s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "871f9a979040f0a7b889bc428222cc58c45dfd71" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.129s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71 --force-share --output=json" returned: 0 in 0.212s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "871f9a979040f0a7b889bc428222cc58c45dfd71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "871f9a979040f0a7b889bc428222cc58c45dfd71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71 --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71,backing_fmt=raw /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71,backing_fmt=raw /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk 1073741824" returned: 0 in 0.072s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "871f9a979040f0a7b889bc428222cc58c45dfd71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:00:39 user nova-compute[75453]: INFO nova.compute.claims [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Claim successful on node user
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71 --force-share --output=json" returned: 0 in 0.244s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Cannot resize image /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Ensure instance console log exists: /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Successfully updated port: 43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquired lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing instance network info cache due to event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] Acquiring lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:00:40 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating instance_info_cache with network_info: [{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Releasing lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Instance network_info: |[{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] Acquired lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Start _get_guest_xml network_info=[{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T14:00:32Z,direct_url=<?>,disk_format='qcow2',id=13624d8f-7316-4efc-8993-8da1904872d5,min_disk=0,min_ram=0,name='tempest-scenario-img--1218031041',owner='f4056ca714ed4e85878d7819ef63b20c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T14:00:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '13624d8f-7316-4efc-8993-8da1904872d5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:00:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T14:00:32Z,direct_url=<?>,disk_format='qcow2',id=13624d8f-7316-4efc-8993-8da1904872d5,min_disk=0,min_ram=0,name='tempest-scenario-img--1218031041',owner='f4056ca714ed4e85878d7819ef63b20c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T14:00:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1236309658',display_name='tempest-TestMinimumBasicScenario-server-1236309658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1236309658',id=16,image_ref='13624d8f-7316-4efc-8993-8da1904872d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYvCKgE/uykfhOgOg6D3nUJ6Umd15sNMuRUU7xu8xWn0qGR9/rUAbuCSIg8mpk+H8TVnl8JQxOpUjgQJBLfW2bLKjH0SnWK8Q02tRGF2ZPKxSiZhErFGWHG+pBmFqIquw==',key_name='tempest-TestMinimumBasicScenario-423384039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4056ca714ed4e85878d7819ef63b20c',ramdisk_id='',reservation_id='r-stm222as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13624d8f-7316-4efc-8993-8da1904872d5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2080131890',owner_user_name='tempest-TestMinimumBasicScenario-2080131890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:00:37Z,user_data=None,user_id='e109047aa8a34d8aad03c6c0dc14c7c8',uuid=ea32aeb2-975a-4295-aeb6-12e177657219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converting VIF {"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.objects.instance [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'pci_devices' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.policy [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '570ac6978fc249ba93d39e40d5d7eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4bdacb213b463cb88e3d046e931b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:00:40 user nova-compute[75453]:   <uuid>ea32aeb2-975a-4295-aeb6-12e177657219</uuid>
Nov 28 14:00:40 user nova-compute[75453]:   <name>instance-00000010</name>
Nov 28 14:00:40 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:00:40 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:00:40 user nova-compute[75453]:   <metadata>
Nov 28 14:00:40 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:00:40 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:00:40 user nova-compute[75453]:       <nova:name>tempest-TestMinimumBasicScenario-server-1236309658</nova:name>
Nov 28 14:00:40 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:00:40</nova:creationTime>
Nov 28 14:00:40 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:00:40 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:00:40 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:00:40 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:00:40 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:00:40 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:00:40 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:00:40 user nova-compute[75453]:       <nova:owner>
Nov 28 14:00:40 user nova-compute[75453]:         <nova:user uuid="e109047aa8a34d8aad03c6c0dc14c7c8">tempest-TestMinimumBasicScenario-2080131890-project-member</nova:user>
Nov 28 14:00:40 user nova-compute[75453]:         <nova:project uuid="f4056ca714ed4e85878d7819ef63b20c">tempest-TestMinimumBasicScenario-2080131890</nova:project>
Nov 28 14:00:40 user nova-compute[75453]:       </nova:owner>
Nov 28 14:00:40 user nova-compute[75453]:       <nova:root type="image" uuid="13624d8f-7316-4efc-8993-8da1904872d5"/>
Nov 28 14:00:40 user nova-compute[75453]:       <nova:ports>
Nov 28 14:00:40 user nova-compute[75453]:         <nova:port uuid="43357932-6c86-4dd1-9f8b-22adab7793b9">
Nov 28 14:00:40 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 14:00:40 user nova-compute[75453]:         </nova:port>
Nov 28 14:00:40 user nova-compute[75453]:       </nova:ports>
Nov 28 14:00:40 user nova-compute[75453]:     </nova:instance>
Nov 28 14:00:40 user nova-compute[75453]:   </metadata>
Nov 28 14:00:40 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:00:40 user nova-compute[75453]:     <system>
Nov 28 14:00:40 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:00:40 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:00:40 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:00:40 user nova-compute[75453]:       <entry name="serial">ea32aeb2-975a-4295-aeb6-12e177657219</entry>
Nov 28 14:00:40 user nova-compute[75453]:       <entry name="uuid">ea32aeb2-975a-4295-aeb6-12e177657219</entry>
Nov 28 14:00:40 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:00:40 user nova-compute[75453]:     </system>
Nov 28 14:00:40 user nova-compute[75453]:   </sysinfo>
Nov 28 14:00:40 user nova-compute[75453]:   <os>
Nov 28 14:00:40 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:00:40 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:00:40 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:00:40 user nova-compute[75453]:   </os>
Nov 28 14:00:40 user nova-compute[75453]:   <features>
Nov 28 14:00:40 user nova-compute[75453]:     <acpi/>
Nov 28 14:00:40 user nova-compute[75453]:     <apic/>
Nov 28 14:00:40 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:00:40 user nova-compute[75453]:   </features>
Nov 28 14:00:40 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:00:40 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:00:40 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:00:40 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:00:40 user nova-compute[75453]:   </clock>
Nov 28 14:00:40 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:00:40 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:00:40 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:00:40 user nova-compute[75453]:   </cpu>
Nov 28 14:00:40 user nova-compute[75453]:   <devices>
Nov 28 14:00:40 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:00:40 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:00:40 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk"/>
Nov 28 14:00:40 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:00:40 user nova-compute[75453]:     </disk>
Nov 28 14:00:40 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:00:40 user nova-compute[75453]:       <mac address="fa:16:3e:a1:ed:0c"/>
Nov 28 14:00:40 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:00:40 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:00:40 user nova-compute[75453]:       <target dev="tap43357932-6c"/>
Nov 28 14:00:40 user nova-compute[75453]:     </interface>
Nov 28 14:00:40 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:00:40 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/console.log" append="off"/>
Nov 28 14:00:40 user nova-compute[75453]:     </serial>
Nov 28 14:00:40 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:00:40 user nova-compute[75453]:     <video>
Nov 28 14:00:40 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:00:40 user nova-compute[75453]:     </video>
Nov 28 14:00:40 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:00:40 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:00:40 user nova-compute[75453]:     </rng>
Nov 28 14:00:40 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:00:40 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:00:40 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:00:40 user nova-compute[75453]:     </memballoon>
Nov 28 14:00:40 user nova-compute[75453]:   </devices>
Nov 28 14:00:40 user nova-compute[75453]: </domain>
Nov 28 14:00:40 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1236309658',display_name='tempest-TestMinimumBasicScenario-server-1236309658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1236309658',id=16,image_ref='13624d8f-7316-4efc-8993-8da1904872d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYvCKgE/uykfhOgOg6D3nUJ6Umd15sNMuRUU7xu8xWn0qGR9/rUAbuCSIg8mpk+H8TVnl8JQxOpUjgQJBLfW2bLKjH0SnWK8Q02tRGF2ZPKxSiZhErFGWHG+pBmFqIquw==',key_name='tempest-TestMinimumBasicScenario-423384039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4056ca714ed4e85878d7819ef63b20c',ramdisk_id='',reservation_id='r-stm222as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13624d8f-7316-4efc-8993-8da1904872d5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2080131890',owner_user_name='tempest-TestMinimumBasicScenario-2080131890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:00:37Z,user_data=None,user_id='e109047aa8a34d8aad03c6c0dc14c7c8',uuid=ea32aeb2-975a-4295-aeb6-12e177657219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converting VIF {"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG os_vif [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:00:40 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Creating image(s)
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "/opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "/opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05bd0d90-5ce7-5189-882f-705acdfbda52', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43357932-6c, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43357932-6c, col_values=(('qos', UUID('c1619616-7ec9-47d8-a4e2-0acdd0a24a9a')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43357932-6c, col_values=(('external_ids', {'iface-id': '43357932-6c86-4dd1-9f8b-22adab7793b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:ed:0c', 'vm-uuid': 'ea32aeb2-975a-4295-aeb6-12e177657219'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:40 user nova-compute[75453]: INFO os_vif [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c')
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] No VIF found with MAC fa:16:3e:a1:ed:0c, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.281s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "6466bc94-8a78-4541-a864-9f0370b212c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updated VIF entry in instance network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating instance_info_cache with network_info: [{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-78f70cb7-12ac-4ca0-9b07-4f7c184ba297 req-379bbb33-8d2b-4161-add7-5d7fdc8e6686 service nova] Releasing lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.257s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:00:40 user nova-compute[75453]: INFO nova.compute.claims [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Claim successful on node user
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk 1073741824" returned: 0 in 0.065s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Cannot resize image /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Ensure instance console log exists: /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.network.neutron [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Successfully created port: c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:00:41 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG nova.policy [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1406382a40d841b5a59d791ec6744fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf581e03a6c4f678536c9d64fe4b8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:00:41 user nova-compute[75453]: INFO nova.virt.block_device [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Booting with volume 0bbc90b3-d676-465d-8b27-6af2a82d5055 at /dev/vda
Nov 28 14:00:41 user nova-compute[75453]: DEBUG os_brick.utils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.040s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed645c81-acc0-46de-bac0-0714d43c93d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8869ba65-d55e-4211-8422-30f23cb1d978]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2c9e8d-3cb8-4abb-b4db-ffdcaadf45f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d5ceff-a7bf-40df-b687-c278b46367da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:00:42 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:00:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fc1cc8-572c-4886-959e-891c2d43492d]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG os_brick.utils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Updating existing volume attachment record: a54c6f31-b8bf-4a7a-8636-59f1be13a527 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] No waiting events found dispatching network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:00:42 user nova-compute[75453]: WARNING nova.compute.manager [req-03fa2b12-8b1b-4271-95c2-bf595bfc7540 req-8f968472-23a7-483c-a8f7-bfef3d30e4ad service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received unexpected event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 for instance with vm_state building and task_state spawning.
Nov 28 14:00:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Successfully updated port: c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "refresh_cache-e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquired lock "refresh_cache-e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Successfully created port: f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Updating instance_info_cache with network_info: [{"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Releasing lock "refresh_cache-e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Instance network_info: |[{"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Start _get_guest_xml network_info=[{"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:00:43 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:43 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1158935620',display_name='tempest-VolumesSnapshotTestJSON-instance-1158935620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1158935620',id=17,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo93KyRIyDIx6msms3X4P0mECSBfI9u3++xg2wVl/gdDfGrNn7vnL5Abe2nYoJ2jZ7cHhRdKoOxjhf3EPdGbXLAD8XisKL8EhjC44s9aWuBca2URk7mIofayLyn9T2BTA==',key_name='tempest-keypair-89595986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff4bdacb213b463cb88e3d046e931b9d',ramdisk_id='',reservation_id='r-giu4q0e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-766520769',owner_user_name='tempest-VolumesSnapshotTestJSON-766520769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:00:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='570ac6978fc249ba93d39e40d5d7eac7',uuid=e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converting VIF {"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9d:a1,bridge_name='br-int',has_traffic_filtering=True,id=c559881f-688d-4805-972f-470ba7cb0c3a,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc559881f-68') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.objects.instance [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'pci_devices' on Instance uuid e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:00:43 user nova-compute[75453]:   <uuid>e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1</uuid>
Nov 28 14:00:43 user nova-compute[75453]:   <name>instance-00000011</name>
Nov 28 14:00:43 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:00:43 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:00:43 user nova-compute[75453]:   <metadata>
Nov 28 14:00:43 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:00:43 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:00:43 user nova-compute[75453]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1158935620</nova:name>
Nov 28 14:00:43 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:00:43</nova:creationTime>
Nov 28 14:00:43 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:00:43 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:00:43 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:00:43 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:00:43 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:00:43 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:00:43 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:00:43 user nova-compute[75453]:       <nova:owner>
Nov 28 14:00:43 user nova-compute[75453]:         <nova:user uuid="570ac6978fc249ba93d39e40d5d7eac7">tempest-VolumesSnapshotTestJSON-766520769-project-member</nova:user>
Nov 28 14:00:43 user nova-compute[75453]:         <nova:project uuid="ff4bdacb213b463cb88e3d046e931b9d">tempest-VolumesSnapshotTestJSON-766520769</nova:project>
Nov 28 14:00:43 user nova-compute[75453]:       </nova:owner>
Nov 28 14:00:43 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:00:43 user nova-compute[75453]:       <nova:ports>
Nov 28 14:00:43 user nova-compute[75453]:         <nova:port uuid="c559881f-688d-4805-972f-470ba7cb0c3a">
Nov 28 14:00:43 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 14:00:43 user nova-compute[75453]:         </nova:port>
Nov 28 14:00:43 user nova-compute[75453]:       </nova:ports>
Nov 28 14:00:43 user nova-compute[75453]:     </nova:instance>
Nov 28 14:00:43 user nova-compute[75453]:   </metadata>
Nov 28 14:00:43 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:00:43 user nova-compute[75453]:     <system>
Nov 28 14:00:43 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:00:43 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:00:43 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:00:43 user nova-compute[75453]:       <entry name="serial">e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1</entry>
Nov 28 14:00:43 user nova-compute[75453]:       <entry name="uuid">e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1</entry>
Nov 28 14:00:43 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:00:43 user nova-compute[75453]:     </system>
Nov 28 14:00:43 user nova-compute[75453]:   </sysinfo>
Nov 28 14:00:43 user nova-compute[75453]:   <os>
Nov 28 14:00:43 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:00:43 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:00:43 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:00:43 user nova-compute[75453]:   </os>
Nov 28 14:00:43 user nova-compute[75453]:   <features>
Nov 28 14:00:43 user nova-compute[75453]:     <acpi/>
Nov 28 14:00:43 user nova-compute[75453]:     <apic/>
Nov 28 14:00:43 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:00:43 user nova-compute[75453]:   </features>
Nov 28 14:00:43 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:00:43 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:00:43 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:00:43 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:00:43 user nova-compute[75453]:   </clock>
Nov 28 14:00:43 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:00:43 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:00:43 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:00:43 user nova-compute[75453]:   </cpu>
Nov 28 14:00:43 user nova-compute[75453]:   <devices>
Nov 28 14:00:43 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:00:43 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:00:43 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk"/>
Nov 28 14:00:43 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:00:43 user nova-compute[75453]:     </disk>
Nov 28 14:00:43 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:00:43 user nova-compute[75453]:       <mac address="fa:16:3e:d5:9d:a1"/>
Nov 28 14:00:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:00:43 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:00:43 user nova-compute[75453]:       <target dev="tapc559881f-68"/>
Nov 28 14:00:43 user nova-compute[75453]:     </interface>
Nov 28 14:00:43 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:00:43 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/console.log" append="off"/>
Nov 28 14:00:43 user nova-compute[75453]:     </serial>
Nov 28 14:00:43 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:00:43 user nova-compute[75453]:     <video>
Nov 28 14:00:43 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:00:43 user nova-compute[75453]:     </video>
Nov 28 14:00:43 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:00:43 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:00:43 user nova-compute[75453]:     </rng>
Nov 28 14:00:43 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:00:43 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:00:43 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:00:43 user nova-compute[75453]:     </memballoon>
Nov 28 14:00:43 user nova-compute[75453]:   </devices>
Nov 28 14:00:43 user nova-compute[75453]: </domain>
Nov 28 14:00:43 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1158935620',display_name='tempest-VolumesSnapshotTestJSON-instance-1158935620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1158935620',id=17,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo93KyRIyDIx6msms3X4P0mECSBfI9u3++xg2wVl/gdDfGrNn7vnL5Abe2nYoJ2jZ7cHhRdKoOxjhf3EPdGbXLAD8XisKL8EhjC44s9aWuBca2URk7mIofayLyn9T2BTA==',key_name='tempest-keypair-89595986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff4bdacb213b463cb88e3d046e931b9d',ramdisk_id='',reservation_id='r-giu4q0e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-766520769',owner_user_name='tempest-VolumesSnapshotTestJSON-766520769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:00:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='570ac6978fc249ba93d39e40d5d7eac7',uuid=e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converting VIF {"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9d:a1,bridge_name='br-int',has_traffic_filtering=True,id=c559881f-688d-4805-972f-470ba7cb0c3a,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc559881f-68') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG os_vif [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9d:a1,bridge_name='br-int',has_traffic_filtering=True,id=c559881f-688d-4805-972f-470ba7cb0c3a,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc559881f-68') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f00406eb-189c-5396-9e2e-778c6c4c174f', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc559881f-68, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc559881f-68, col_values=(('qos', UUID('487ab4fe-c194-4da2-9d53-fc7482091555')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc559881f-68, col_values=(('external_ids', {'iface-id': 'c559881f-688d-4805-972f-470ba7cb0c3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:9d:a1', 'vm-uuid': 'e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:43 user nova-compute[75453]: INFO os_vif [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9d:a1,bridge_name='br-int',has_traffic_filtering=True,id=c559881f-688d-4805-972f-470ba7cb0c3a,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc559881f-68')
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Successfully updated port: f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No VIF found with MAC fa:16:3e:d5:9d:a1, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "refresh_cache-6466bc94-8a78-4541-a864-9f0370b212c1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquired lock "refresh_cache-6466bc94-8a78-4541-a864-9f0370b212c1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.compute.manager [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-changed-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.compute.manager [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Refreshing instance network info cache due to event network-changed-f85d8e95-0038-4312-bfc1-28b0a2354a09. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] Acquiring lock "refresh_cache-6466bc94-8a78-4541-a864-9f0370b212c1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Updating instance_info_cache with network_info: [{"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Releasing lock "refresh_cache-6466bc94-8a78-4541-a864-9f0370b212c1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance network_info: |[{"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] Acquired lock "refresh_cache-6466bc94-8a78-4541-a864-9f0370b212c1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:00:43 user nova-compute[75453]: DEBUG nova.network.neutron [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Refreshing network info cache for port f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.network.neutron [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Updated VIF entry in instance network info cache for port f85d8e95-0038-4312-bfc1-28b0a2354a09. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.network.neutron [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Updating instance_info_cache with network_info: [{"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-39611159-5b9f-4eff-b3bd-c6bc918b0cea req-442233bb-d084-449d-b7e6-c5b7e441f9f5 service nova] Releasing lock "refresh_cache-6466bc94-8a78-4541-a864-9f0370b212c1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received event network-changed-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Refreshing instance network info cache due to event network-changed-c559881f-688d-4805-972f-470ba7cb0c3a. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Acquiring lock "refresh_cache-e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Acquired lock "refresh_cache-e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.network.neutron [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Refreshing network info cache for port c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:00:44 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Instance spawned successfully.
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:44 user nova-compute[75453]: INFO nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Took 7.34 seconds to spawn the instance on the hypervisor.
Nov 28 14:00:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:45 user nova-compute[75453]: INFO nova.compute.manager [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Took 8.79 seconds to build instance.
Nov 28 14:00:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de8f63f6-97ec-4f7d-b357-cbc55cdec7ec tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.924s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received event network-vif-plugged-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] No waiting events found dispatching network-vif-plugged-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:00:45 user nova-compute[75453]: WARNING nova.compute.manager [req-ccbd90b0-66d4-45ad-b610-b46f8cd612ed req-e6b60faa-fa85-4b57-90ba-d613b8bd2018 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received unexpected event network-vif-plugged-c559881f-688d-4805-972f-470ba7cb0c3a for instance with vm_state building and task_state spawning.
Nov 28 14:00:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Updated VIF entry in instance network info cache for port c559881f-688d-4805-972f-470ba7cb0c3a. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Updating instance_info_cache with network_info: [{"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Releasing lock "refresh_cache-e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] No waiting events found dispatching network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:00:45 user nova-compute[75453]: WARNING nova.compute.manager [req-d90c8f16-84d6-45ba-9f39-14752ba9b2fb req-67e49774-58ad-4fee-ba19-e38d331c6ebc service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received unexpected event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 for instance with vm_state building and task_state spawning.
Nov 28 14:00:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:00:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Instance spawned successfully.
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received event network-vif-plugged-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] No waiting events found dispatching network-vif-plugged-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:00:47 user nova-compute[75453]: WARNING nova.compute.manager [req-278098ff-341c-427a-b09f-b2943a9f97fc req-a174d46c-baea-4bfd-96e4-4c5c41b3b7bb service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received unexpected event network-vif-plugged-c559881f-688d-4805-972f-470ba7cb0c3a for instance with vm_state building and task_state spawning.
Nov 28 14:00:47 user nova-compute[75453]: INFO nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 28 14:00:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:00:47 user nova-compute[75453]: INFO nova.compute.manager [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Took 8.51 seconds to build instance.
Nov 28 14:00:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-da0f3705-8278-47b2-b918-110c7cb15d09 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.689s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:00:51 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Creating image(s)
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Ensure instance console log exists: /opt/stack/data/nova/instances/6466bc94-8a78-4541-a864-9f0370b212c1/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Start _get_guest_xml network_info=[{"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a54c6f31-b8bf-4a7a-8636-59f1be13a527', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMKPzAfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6466bc94-8a78-4541-a864-9f0370b212c1', 'attached_at': '', 'detached_at': '', 'volume_id': '0bbc90b3-d676-465d-8b27-6af2a82d5055', 'serial': '0bbc90b3-d676-465d-8b27-6af2a82d5055'}, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:00:51 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:51 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMKPzAfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:00:51 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:00:51 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:00:51 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a9c94a-90e5-43c7-a8c6-467bcf55ac25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:00:51 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[988f231e-5a9a-41e4-9eae-0b3a745c8ea9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055] added
Nov 28 14:00:51 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2781577-6d21-48e4-a59c-0da6e727b0cf]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf86f7b7-0dff-48a6-9b0d-4d3a02540413]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMKPzAfh {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMKPzAfh" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb00febb-193e-4944-8445-3fcf4edb79b6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uMKPzAfh'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c81ef9b-0cd7-448f-a77a-7c11c130f2ec]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a66b666-9e71-468a-8535-a27a8032124b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cae6c38-3c3f-43e7-b596-2d34de7067a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260]
Nov 28 14:00:51 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260] successful.
Nov 28 14:00:51 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3351e9-acb1-4855-a24d-55fee982253e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca2ee32-a857-4386-8d04-b864f81ddd91]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:00:51 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3445d568-fef9-4dc1-b49f-b3454e477ffb]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:00:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMKPzAfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23030343365323831', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030343365323831', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1576957829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1576957829',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCE1KdXUl0gyKQN8cxHdQBSdoIOXAXck9gShrFsDuTComCOmZg1HXlk/E0PRpSF3JI/duBB0wGIY1DEhRduzsv/cvgYCVHRukYUjTiF6VZpcGAYot9rGCCTrNA5JY+6g==',key_name='tempest-keypair-1958037787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbf581e03a6c4f678536c9d64fe4b8cc',ramdisk_id='',reservation_id='r-le3gxts7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2097640131',owner_user_name='tempest-ServerActionsV293TestJSON-2097640131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1406382a40d841b5a59d791ec6744fc4',uuid=6466bc94-8a78-4541-a864-9f0370b212c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converting VIF {"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lazy-loading 'pci_devices' on Instance uuid 6466bc94-8a78-4541-a864-9f0370b212c1 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:00:52 user nova-compute[75453]:   <uuid>6466bc94-8a78-4541-a864-9f0370b212c1</uuid>
Nov 28 14:00:52 user nova-compute[75453]:   <name>instance-00000012</name>
Nov 28 14:00:52 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:00:52 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:00:52 user nova-compute[75453]:   <metadata>
Nov 28 14:00:52 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:00:52 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:00:52 user nova-compute[75453]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1576957829</nova:name>
Nov 28 14:00:52 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:00:51</nova:creationTime>
Nov 28 14:00:52 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:00:52 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:00:52 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:00:52 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:00:52 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:00:52 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:00:52 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:00:52 user nova-compute[75453]:       <nova:owner>
Nov 28 14:00:52 user nova-compute[75453]:         <nova:user uuid="1406382a40d841b5a59d791ec6744fc4">tempest-ServerActionsV293TestJSON-2097640131-project-member</nova:user>
Nov 28 14:00:52 user nova-compute[75453]:         <nova:project uuid="cbf581e03a6c4f678536c9d64fe4b8cc">tempest-ServerActionsV293TestJSON-2097640131</nova:project>
Nov 28 14:00:52 user nova-compute[75453]:       </nova:owner>
Nov 28 14:00:52 user nova-compute[75453]:       <nova:ports>
Nov 28 14:00:52 user nova-compute[75453]:         <nova:port uuid="f85d8e95-0038-4312-bfc1-28b0a2354a09">
Nov 28 14:00:52 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:00:52 user nova-compute[75453]:         </nova:port>
Nov 28 14:00:52 user nova-compute[75453]:       </nova:ports>
Nov 28 14:00:52 user nova-compute[75453]:     </nova:instance>
Nov 28 14:00:52 user nova-compute[75453]:   </metadata>
Nov 28 14:00:52 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:00:52 user nova-compute[75453]:     <system>
Nov 28 14:00:52 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:00:52 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:00:52 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:00:52 user nova-compute[75453]:       <entry name="serial">6466bc94-8a78-4541-a864-9f0370b212c1</entry>
Nov 28 14:00:52 user nova-compute[75453]:       <entry name="uuid">6466bc94-8a78-4541-a864-9f0370b212c1</entry>
Nov 28 14:00:52 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:00:52 user nova-compute[75453]:     </system>
Nov 28 14:00:52 user nova-compute[75453]:   </sysinfo>
Nov 28 14:00:52 user nova-compute[75453]:   <os>
Nov 28 14:00:52 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:00:52 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:00:52 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:00:52 user nova-compute[75453]:   </os>
Nov 28 14:00:52 user nova-compute[75453]:   <features>
Nov 28 14:00:52 user nova-compute[75453]:     <acpi/>
Nov 28 14:00:52 user nova-compute[75453]:     <apic/>
Nov 28 14:00:52 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:00:52 user nova-compute[75453]:   </features>
Nov 28 14:00:52 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:00:52 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:00:52 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:00:52 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:00:52 user nova-compute[75453]:   </clock>
Nov 28 14:00:52 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:00:52 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:00:52 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:00:52 user nova-compute[75453]:   </cpu>
Nov 28 14:00:52 user nova-compute[75453]:   <devices>
Nov 28 14:00:52 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:00:52 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:00:52 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:00:52 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:00:52 user nova-compute[75453]:       <serial>0bbc90b3-d676-465d-8b27-6af2a82d5055</serial>
Nov 28 14:00:52 user nova-compute[75453]:     </disk>
Nov 28 14:00:52 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:00:52 user nova-compute[75453]:       <mac address="fa:16:3e:c7:e0:b2"/>
Nov 28 14:00:52 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:00:52 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:00:52 user nova-compute[75453]:       <target dev="tapf85d8e95-00"/>
Nov 28 14:00:52 user nova-compute[75453]:     </interface>
Nov 28 14:00:52 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:00:52 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/6466bc94-8a78-4541-a864-9f0370b212c1/console.log" append="off"/>
Nov 28 14:00:52 user nova-compute[75453]:     </serial>
Nov 28 14:00:52 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:00:52 user nova-compute[75453]:     <video>
Nov 28 14:00:52 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:00:52 user nova-compute[75453]:     </video>
Nov 28 14:00:52 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:00:52 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:00:52 user nova-compute[75453]:     </rng>
Nov 28 14:00:52 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:00:52 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:00:52 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:00:52 user nova-compute[75453]:     </memballoon>
Nov 28 14:00:52 user nova-compute[75453]:   </devices>
Nov 28 14:00:52 user nova-compute[75453]: </domain>
Nov 28 14:00:52 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1576957829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1576957829',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCE1KdXUl0gyKQN8cxHdQBSdoIOXAXck9gShrFsDuTComCOmZg1HXlk/E0PRpSF3JI/duBB0wGIY1DEhRduzsv/cvgYCVHRukYUjTiF6VZpcGAYot9rGCCTrNA5JY+6g==',key_name='tempest-keypair-1958037787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbf581e03a6c4f678536c9d64fe4b8cc',ramdisk_id='',reservation_id='r-le3gxts7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2097640131',owner_user_name='tempest-ServerActionsV293TestJSON-2097640131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1406382a40d841b5a59d791ec6744fc4',uuid=6466bc94-8a78-4541-a864-9f0370b212c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converting VIF {"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG os_vif [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22306c76-0120-5f7d-bb71-2e8eb2566d19', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf85d8e95-00, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf85d8e95-00, col_values=(('qos', UUID('40651a9f-96db-4ec9-9d32-9c15490a26ee')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf85d8e95-00, col_values=(('external_ids', {'iface-id': 'f85d8e95-0038-4312-bfc1-28b0a2354a09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:e0:b2', 'vm-uuid': '6466bc94-8a78-4541-a864-9f0370b212c1'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:52 user nova-compute[75453]: INFO os_vif [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00')
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:00:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] No VIF found with MAC fa:16:3e:c7:e0:b2, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:00:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] No waiting events found dispatching network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:00:54 user nova-compute[75453]: WARNING nova.compute.manager [req-2a887ed1-dc4f-416a-8186-d6097f189bad req-d3dfb413-c5ab-44af-bdf7-e33614ad8fae service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received unexpected event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance with vm_state building and task_state spawning.
Nov 28 14:00:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] No waiting events found dispatching network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:00:56 user nova-compute[75453]: WARNING nova.compute.manager [req-dda7d961-f5c9-495c-830d-e8743b3aa710 req-84e48c4b-1289-4e74-a395-fc570f61532f service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received unexpected event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance with vm_state building and task_state spawning.
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:00:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance spawned successfully.
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:00:56 user nova-compute[75453]: INFO nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 28 14:00:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:00:57 user nova-compute[75453]: INFO nova.compute.manager [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Took 16.31 seconds to build instance.
Nov 28 14:00:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d23574a6-cbf9-4ee6-9c28-0927d8ebd676 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "6466bc94-8a78-4541-a864-9f0370b212c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.497s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:00:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:00:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:03 user nova-compute[75453]: INFO nova.compute.manager [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Detaching volume a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 14:01:03 user nova-compute[75453]: INFO nova.virt.block_device [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Attempting to driver detach volume a6dd3f41-6624-4976-8316-6d52ce2c4373 from mountpoint /dev/vdb
Nov 28 14:01:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Attempting to detach device vdb from instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:01:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:01:03 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:01:03 user nova-compute[75453]:   <source dev="/dev/sdd"/>
Nov 28 14:01:03 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:01:03 user nova-compute[75453]:   <serial>a6dd3f41-6624-4976-8316-6d52ce2c4373</serial>
Nov 28 14:01:03 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 14:01:03 user nova-compute[75453]: </disk>
Nov 28 14:01:03 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:01:03 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully detached device vdb from instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 from the persistent domain config.
Nov 28 14:01:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:01:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:01:03 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:01:03 user nova-compute[75453]:   <source dev="/dev/sdd"/>
Nov 28 14:01:03 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:01:03 user nova-compute[75453]:   <serial>a6dd3f41-6624-4976-8316-6d52ce2c4373</serial>
Nov 28 14:01:03 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 14:01:03 user nova-compute[75453]: </disk>
Nov 28 14:01:03 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:01:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Port 36d6817d-5a86-4e22-90cd-adfe2b3f176e binding to destination host user is already ACTIVE {{(pid=75453) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquired lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "949a3612-5042-420f-9911-ec641017d399" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "949a3612-5042-420f-9911-ec641017d399-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:05 user nova-compute[75453]: INFO nova.compute.manager [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Terminating instance
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance_info_cache with network_info: [{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Releasing lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received event network-vif-unplugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] Acquiring lock "949a3612-5042-420f-9911-ec641017d399-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] Lock "949a3612-5042-420f-9911-ec641017d399-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] Lock "949a3612-5042-420f-9911-ec641017d399-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] No waiting events found dispatching network-vif-unplugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-d99c2682-b8b6-4e8e-ac33-008ddb2da7e9 req-0afa3826-51cc-4817-836c-b1490f7adb3e service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received event network-vif-unplugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Creating tmpfile /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/tmp7qhfnvc2 to verify with other compute node that the instance is on the same shared storage. {{(pid=75453) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 28 14:01:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 949a3612-5042-420f-9911-ec641017d399] Instance destroyed successfully.
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'resources' on Instance uuid 949a3612-5042-420f-9911-ec641017d399 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-462278016',display_name='tempest-AttachVolumeNegativeTest-server-462278016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-462278016',id=4,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEurKFzowQcp2NLIRyfnyakH2lqBVHuoHwmKYo7DloY5HmCUCDn4ZANWNR9sovmCPmqCPQf1ocz3QVX5DnNCT72PukED7dIYoq4XGJEjcy1YchSPVrm0tfF5cMKIzfF5ug==',key_name='tempest-keypair-2064566278',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-foaz04oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=949a3612-5042-420f-9911-ec641017d399,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "address": "fa:16:3e:83:c2:36", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4432eb7-37", "ovs_interfaceid": "c4432eb7-3703-49b9-afd1-534fdd4065b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=c4432eb7-3703-49b9-afd1-534fdd4065b4,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4432eb7-37') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_vif [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=c4432eb7-3703-49b9-afd1-534fdd4065b4,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4432eb7-37') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4432eb7-37, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d085f039-415c-440c-a869-d845648cc35e) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: INFO os_vif [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=c4432eb7-3703-49b9-afd1-534fdd4065b4,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4432eb7-37')
Nov 28 14:01:06 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Deleting instance files /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399_del
Nov 28 14:01:06 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Deletion of /opt/stack/data/nova/instances/949a3612-5042-420f-9911-ec641017d399_del complete
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-unplugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-unplugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:06 user nova-compute[75453]: WARNING nova.compute.manager [req-510ed10a-f2e2-421f-a3b8-ca3afe479ce6 req-5a6535e9-2bda-4c01-b4ff-09eda964b9b0 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-unplugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state resized and task_state resize_reverting.
Nov 28 14:01:06 user nova-compute[75453]: INFO nova.compute.manager [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 949a3612-5042-420f-9911-ec641017d399] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 949a3612-5042-420f-9911-ec641017d399] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 949a3612-5042-420f-9911-ec641017d399] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:01:06 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance destroyed successfully.
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lazy-loading 'resources' on Instance uuid 9a32cb51-7b87-4d9b-9e94-72cb60f4371f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-370204766',display_name='tempest-ServerActionsTestOtherB-server-370204766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-370204766',id=3,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg==',key_name='tempest-keypair-2095208703',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d326de84f8224cef95e650bd92e7198f',ramdisk_id='',reservation_id='r-0iqcbio7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1799325713',owner_user_name='tempest-ServerActionsTestOtherB-1799325713-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14da9954e4fc44deb3c603165b10cf66',uuid=9a32cb51-7b87-4d9b-9e94-72cb60f4371f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converting VIF {"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_vif [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36d6817d-5a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef2e99b9-2895-4118-80ae-0ff3eaab206d) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:06 user nova-compute[75453]: INFO os_vif [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a')
Nov 28 14:01:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:01:06 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e904023c-8c0d-4daf-91dc-78bc0b656082]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:01:06 user nova-compute[75453]: No targets found.
Nov 28 14:01:06 user nova-compute[75453]: iSNS:
Nov 28 14:01:06 user nova-compute[75453]: No targets found.
Nov 28 14:01:06 user nova-compute[75453]: STATIC:
Nov 28 14:01:06 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:01:06 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:06 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:06 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:01:06 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:06 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:06 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 14:01:06 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:06 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:06 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 14:01:06 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:06 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:06 user nova-compute[75453]: FIRMWARE:
Nov 28 14:01:06 user nova-compute[75453]: No targets found.
Nov 28 14:01:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:01:06 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:01:06 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7866d669-55ec-4f43-8f36-d0ce2fb37417]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab0a1a-56f4-4c2b-a1d6-5d858462eec0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:06 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:01:06 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:06 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:06 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:01:06 user nova-compute[75453]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:06 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02186ffd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bdf5d1-428e-461b-b713-3439ce342d07]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53d70e1-3f47-4f32-996b-a6b71e7dd078]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7348475-4c92-4408-b37d-e45556cb00fa]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:01:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d2e1a-48f6-447f-bded-396fef3e1379]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948f778-b6b4-4f1a-827d-db4552dafa56]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eda765-e071-407f-a84f-34152023a66b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]
Nov 28 14:01:07 user nova-compute[75453]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.
Nov 28 14:01:07 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[545a575c-2221-43ac-b22d-87bbaf37f35a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] <== disconnect_volume: return (455ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 949a3612-5042-420f-9911-ec641017d399] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:01:07 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 949a3612-5042-420f-9911-ec641017d399] Took 1.32 seconds to deallocate network for instance.
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received event network-vif-plugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] Acquiring lock "949a3612-5042-420f-9911-ec641017d399-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] Lock "949a3612-5042-420f-9911-ec641017d399-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] Lock "949a3612-5042-420f-9911-ec641017d399-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] No waiting events found dispatching network-vif-plugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:07 user nova-compute[75453]: WARNING nova.compute.manager [req-c5242541-45b0-4d85-a036-fd737b2c1a79 req-f8ec721c-3ba6-4be2-bc03-103c1be3e283 service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received unexpected event network-vif-plugged-c4432eb7-3703-49b9-afd1-534fdd4065b4 for instance with vm_state deleted and task_state None.
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.693s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:08 user nova-compute[75453]: WARNING nova.compute.manager [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state resized and task_state resize_reverting.
Nov 28 14:01:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-37760dd8-9b99-482a-89ec-2137864a5a54 req-ce1cdc08-ee4c-4c10-a134-9523186a604e service nova] [instance: 949a3612-5042-420f-9911-ec641017d399] Received event network-vif-deleted-c4432eb7-3703-49b9-afd1-534fdd4065b4 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:08 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Deleted allocations for instance 949a3612-5042-420f-9911-ec641017d399
Nov 28 14:01:08 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lazy-loading 'migration_context' on Instance uuid 9a32cb51-7b87-4d9b-9e94-72cb60f4371f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG nova.objects.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Object Instance<9a32cb51-7b87-4d9b-9e94-72cb60f4371f> lazy-loaded attributes: resources,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8df49ff-8e40-411c-b5f6-b3ec5957a4ef tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "949a3612-5042-420f-9911-ec641017d399" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.200s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.597s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:09 user nova-compute[75453]: INFO nova.compute.manager [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Swapping old allocation on dict_keys(['4cacb5b9-170e-4610-a8bb-0f50950f49d5']) held by migration 5a7ab958-c206-4dd9-a612-ddf8f4bde9ed for instance
Nov 28 14:01:09 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Overwriting current allocation {'allocations': {'4cacb5b9-170e-4610-a8bb-0f50950f49d5': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': 'd326de84f8224cef95e650bd92e7198f', 'user_id': '14da9954e4fc44deb3c603165b10cf66', 'consumer_generation': 1} on consumer 9a32cb51-7b87-4d9b-9e94-72cb60f4371f {{(pid=75453) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquired lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:09 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Error from libvirt while getting description of instance-00000003: [Error Code 42] Domain not found: no domain with matching uuid '9a32cb51-7b87-4d9b-9e94-72cb60f4371f' (instance-00000003): libvirt.libvirtError: Domain not found: no domain with matching uuid '9a32cb51-7b87-4d9b-9e94-72cb60f4371f' (instance-00000003)
Nov 28 14:01:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:01:10 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:01:10 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7621MB free_disk=25.282787322998047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance_info_cache with network_info: [{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 48dd0221-4935-4ee2-9958-90a748fe5255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 3907babd-71af-4fca-8ad7-4a7dae1710d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 66c010a7-3604-41c4-9599-d41172a28fe2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance ea32aeb2-975a-4295-aeb6-12e177657219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 6466bc94-8a78-4541-a864-9f0370b212c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Releasing lock "refresh_cache-9a32cb51-7b87-4d9b-9e94-72cb60f4371f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG os_brick.utils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af9b689-da10-4757-b76b-bf9bb00bd082]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8801ba-fd22-485f-b0ba-ad5f446f2371]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c938d2-f4aa-4022-9bf8-3f945f13c9c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb3cda7-72e3-4bc4-9c53-011cb683f78a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:01:10 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41f0494-7f52-4f8d-a131-0659fb5ddfde]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG os_brick.utils [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:01:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.772s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:01:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Updating instance_info_cache with network_info: [{"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-66c010a7-3604-41c4-9599-d41172a28fe2" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:01:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:16 user nova-compute[75453]: INFO nova.compute.manager [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Terminating instance
Nov 28 14:01:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-vif-unplugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] No waiting events found dispatching network-vif-unplugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-aaeef321-ab5b-487a-a773-53f1abfea02e req-660f37d8-43f3-4774-b2fd-8a8488a820a9 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-vif-unplugged-b0710703-b905-47cd-bf04-c07eb065364e for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Instance destroyed successfully.
Nov 28 14:01:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lazy-loading 'resources' on Instance uuid 3907babd-71af-4fca-8ad7-4a7dae1710d6 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2036539272',display_name='tempest-VolumesAdminNegativeTest-server-2036539272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2036539272',id=5,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJBP38LrSeECryJxQCpE/WiHIW+aDF65IhTudWGMrLGYW0xa/psYC/7M2yDVYu5HJRMMQSALCu3mXia21ivoTFH56dqp27J4aTQ35ItkZ8oC2jGFWLCbfMiEmkHahxHTQ==',key_name='tempest-keypair-776308576',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75b572682eb94af0b628ee30a16d9225',ramdisk_id='',reservation_id='r-882ky2o7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-963761222',owner_user_name='tempest-VolumesAdminNegativeTest-963761222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9f9b1cc04a4417ebf987aa99a18e6a7',uuid=3907babd-71af-4fca-8ad7-4a7dae1710d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converting VIF {"id": "b0710703-b905-47cd-bf04-c07eb065364e", "address": "fa:16:3e:35:eb:14", "network": {"id": "efa0e0e2-5675-40e1-9d88-b46b666489be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1112367589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75b572682eb94af0b628ee30a16d9225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0710703-b9", "ovs_interfaceid": "b0710703-b905-47cd-bf04-c07eb065364e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:eb:14,bridge_name='br-int',has_traffic_filtering=True,id=b0710703-b905-47cd-bf04-c07eb065364e,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0710703-b9') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG os_vif [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:eb:14,bridge_name='br-int',has_traffic_filtering=True,id=b0710703-b905-47cd-bf04-c07eb065364e,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0710703-b9') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0710703-b9, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d07609da-fa8b-439c-a1e1-3519f7265106) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: INFO os_vif [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:eb:14,bridge_name='br-int',has_traffic_filtering=True,id=b0710703-b905-47cd-bf04-c07eb065364e,network=Network(efa0e0e2-5675-40e1-9d88-b46b666489be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0710703-b9')
Nov 28 14:01:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Deleting instance files /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6_del
Nov 28 14:01:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Deletion of /opt/stack/data/nova/instances/3907babd-71af-4fca-8ad7-4a7dae1710d6_del complete
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: INFO nova.compute.manager [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 14:01:17 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:01:18 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Took 0.98 seconds to deallocate network for instance.
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-2866a8b4-7fa5-4950-94c9-9001325e6920 req-11663a35-07ae-4363-909b-28843247c8ba service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-vif-deleted-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Starting finish_revert_migration {{(pid=75453) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Start _get_guest_xml network_info=[{"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f51417c6-6a95-432a-88cf-2edf4d7de926', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9a32cb51-7b87-4d9b-9e94-72cb60f4371f', 'attached_at': '2023-11-28T14:01:18.000000', 'detached_at': '', 'volume_id': '95820667-5de5-45e2-a99e-67643abf1bb1', 'serial': '95820667-5de5-45e2-a99e-67643abf1bb1'}, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:01:18 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:01:18 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9a32cb51-7b87-4d9b-9e94-72cb60f4371f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:01:18 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:01:18 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:01:18 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b88bf8-6e2f-4e28-af1e-a8517d6c505c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:01:18 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a55d78-e46b-452b-8202-1dc75f8ca375]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1] added
Nov 28 14:01:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3919981-83d6-4bb0-9b0a-7b295b002cf3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0be955-50e1-4c59-a60c-38a5cfcb3b32]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoMBphND {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LoMBphND" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[031cb010-2243-47e5-b56e-a3641c5b9f14]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LoMBphND'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eceda98-b4cc-4040-9fa7-76368cbbc4f3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:18 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Deleted allocations for instance 3907babd-71af-4fca-8ad7-4a7dae1710d6
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9112eb47-00e5-4582-8bd9-7e7a20839082]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] No waiting events found dispatching network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:19 user nova-compute[75453]: WARNING nova.compute.manager [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received unexpected event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e for instance with vm_state deleted and task_state None.
Nov 28 14:01:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] No waiting events found dispatching network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:19 user nova-compute[75453]: WARNING nova.compute.manager [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received unexpected event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e for instance with vm_state deleted and task_state None.
Nov 28 14:01:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Acquiring lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] No waiting events found dispatching network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:19 user nova-compute[75453]: WARNING nova.compute.manager [req-17720af0-c900-4608-b0b3-626d01942e50 req-5ce38ce4-77ff-4c23-93ef-e53fed70a8a4 service nova] [instance: 3907babd-71af-4fca-8ad7-4a7dae1710d6] Received unexpected event network-vif-plugged-b0710703-b905-47cd-bf04-c07eb065364e for instance with vm_state deleted and task_state None.
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dcf6b393-b8b8-4d23-b365-6e791643025a tempest-VolumesAdminNegativeTest-963761222 tempest-VolumesAdminNegativeTest-963761222-project-member] Lock "3907babd-71af-4fca-8ad7-4a7dae1710d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.816s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7591289e-08f8-4b67-bd0c-0173ffbe5b11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]
Nov 28 14:01:19 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.
Nov 28 14:01:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d3c078-ebcf-44f9-991e-6cf572eba76a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a390fdf-d304-4015-8138-875d88a2c72d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.628s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b69a5-7df3-4b33-a488-ac9ee94067e2]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:01:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.662s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] <== connect_volume: return (1663ms) {'type': 'block', 'scsi_wwn': '23131323833653435', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131323833653435', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-370204766',display_name='tempest-ServerActionsTestOtherB-server-370204766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-370204766',id=3,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg==',key_name='tempest-keypair-2095208703',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d326de84f8224cef95e650bd92e7198f',ramdisk_id='',reservation_id='r-0iqcbio7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1799325713',owner_user_name='tempest-ServerActionsTestOtherB-1799325713-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14da9954e4fc44deb3c603165b10cf66',uuid=9a32cb51-7b87-4d9b-9e94-72cb60f4371f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converting VIF {"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:01:20 user nova-compute[75453]:   <uuid>9a32cb51-7b87-4d9b-9e94-72cb60f4371f</uuid>
Nov 28 14:01:20 user nova-compute[75453]:   <name>instance-00000003</name>
Nov 28 14:01:20 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:01:20 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:01:20 user nova-compute[75453]:   <metadata>
Nov 28 14:01:20 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:01:20 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:01:20 user nova-compute[75453]:       <nova:name>tempest-ServerActionsTestOtherB-server-370204766</nova:name>
Nov 28 14:01:20 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:01:18</nova:creationTime>
Nov 28 14:01:20 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:01:20 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:01:20 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:01:20 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:01:20 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:01:20 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:01:20 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:01:20 user nova-compute[75453]:       <nova:owner>
Nov 28 14:01:20 user nova-compute[75453]:         <nova:user uuid="14da9954e4fc44deb3c603165b10cf66">tempest-ServerActionsTestOtherB-1799325713-project-member</nova:user>
Nov 28 14:01:20 user nova-compute[75453]:         <nova:project uuid="d326de84f8224cef95e650bd92e7198f">tempest-ServerActionsTestOtherB-1799325713</nova:project>
Nov 28 14:01:20 user nova-compute[75453]:       </nova:owner>
Nov 28 14:01:20 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:01:20 user nova-compute[75453]:       <nova:ports>
Nov 28 14:01:20 user nova-compute[75453]:         <nova:port uuid="36d6817d-5a86-4e22-90cd-adfe2b3f176e">
Nov 28 14:01:20 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 14:01:20 user nova-compute[75453]:         </nova:port>
Nov 28 14:01:20 user nova-compute[75453]:       </nova:ports>
Nov 28 14:01:20 user nova-compute[75453]:     </nova:instance>
Nov 28 14:01:20 user nova-compute[75453]:   </metadata>
Nov 28 14:01:20 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:01:20 user nova-compute[75453]:     <system>
Nov 28 14:01:20 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:01:20 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:01:20 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:01:20 user nova-compute[75453]:       <entry name="serial">9a32cb51-7b87-4d9b-9e94-72cb60f4371f</entry>
Nov 28 14:01:20 user nova-compute[75453]:       <entry name="uuid">9a32cb51-7b87-4d9b-9e94-72cb60f4371f</entry>
Nov 28 14:01:20 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:01:20 user nova-compute[75453]:     </system>
Nov 28 14:01:20 user nova-compute[75453]:   </sysinfo>
Nov 28 14:01:20 user nova-compute[75453]:   <os>
Nov 28 14:01:20 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:01:20 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:01:20 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:01:20 user nova-compute[75453]:   </os>
Nov 28 14:01:20 user nova-compute[75453]:   <features>
Nov 28 14:01:20 user nova-compute[75453]:     <acpi/>
Nov 28 14:01:20 user nova-compute[75453]:     <apic/>
Nov 28 14:01:20 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:01:20 user nova-compute[75453]:   </features>
Nov 28 14:01:20 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:01:20 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:01:20 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:01:20 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:01:20 user nova-compute[75453]:   </clock>
Nov 28 14:01:20 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:01:20 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:01:20 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:01:20 user nova-compute[75453]:   </cpu>
Nov 28 14:01:20 user nova-compute[75453]:   <devices>
Nov 28 14:01:20 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:01:20 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:01:20 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk"/>
Nov 28 14:01:20 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:01:20 user nova-compute[75453]:     </disk>
Nov 28 14:01:20 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:01:20 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:01:20 user nova-compute[75453]:       <source dev="/dev/sdc"/>
Nov 28 14:01:20 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 14:01:20 user nova-compute[75453]:       <serial>95820667-5de5-45e2-a99e-67643abf1bb1</serial>
Nov 28 14:01:20 user nova-compute[75453]:     </disk>
Nov 28 14:01:20 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:01:20 user nova-compute[75453]:       <mac address="fa:16:3e:c0:6b:2f"/>
Nov 28 14:01:20 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:01:20 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:01:20 user nova-compute[75453]:       <target dev="tap36d6817d-5a"/>
Nov 28 14:01:20 user nova-compute[75453]:     </interface>
Nov 28 14:01:20 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:01:20 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/console.log" append="off"/>
Nov 28 14:01:20 user nova-compute[75453]:     </serial>
Nov 28 14:01:20 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:01:20 user nova-compute[75453]:     <video>
Nov 28 14:01:20 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:01:20 user nova-compute[75453]:     </video>
Nov 28 14:01:20 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:01:20 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:01:20 user nova-compute[75453]:     </rng>
Nov 28 14:01:20 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:01:20 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:01:20 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:01:20 user nova-compute[75453]:     </memballoon>
Nov 28 14:01:20 user nova-compute[75453]:   </devices>
Nov 28 14:01:20 user nova-compute[75453]: </domain>
Nov 28 14:01:20 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-370204766',display_name='tempest-ServerActionsTestOtherB-server-370204766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-370204766',id=3,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg==',key_name='tempest-keypair-2095208703',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d326de84f8224cef95e650bd92e7198f',ramdisk_id='',reservation_id='r-0iqcbio7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1799325713',owner_user_name='tempest-ServerActionsTestOtherB-1799325713-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14da9954e4fc44deb3c603165b10cf66',uuid=9a32cb51-7b87-4d9b-9e94-72cb60f4371f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converting VIF {"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG os_vif [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16449ee4-b347-5841-87ae-acfdb3982287', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36d6817d-5a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36d6817d-5a, col_values=(('qos', UUID('fb61cd09-191e-467a-a840-6cad3e1f450b')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36d6817d-5a, col_values=(('external_ids', {'iface-id': '36d6817d-5a86-4e22-90cd-adfe2b3f176e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:6b:2f', 'vm-uuid': '9a32cb51-7b87-4d9b-9e94-72cb60f4371f'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:20 user nova-compute[75453]: INFO os_vif [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a')
Nov 28 14:01:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_power_states {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 48dd0221-4935-4ee2-9958-90a748fe5255 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 9a32cb51-7b87-4d9b-9e94-72cb60f4371f {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 66c010a7-3604-41c4-9599-d41172a28fe2 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 6466bc94-8a78-4541-a864-9f0370b212c1 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "48dd0221-4935-4ee2-9958-90a748fe5255" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "48dd0221-4935-4ee2-9958-90a748fe5255" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:23 user nova-compute[75453]: INFO nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "6466bc94-8a78-4541-a864-9f0370b212c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "48dd0221-4935-4ee2-9958-90a748fe5255" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "6466bc94-8a78-4541-a864-9f0370b212c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:01:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance running successfully.
Nov 28 14:01:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] finish_revert_migration finished successfully. {{(pid=75453) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 28 14:01:24 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 is timed out.
Nov 28 14:01:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully detached device vdb from instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 from the live domain config.
Nov 28 14:01:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UODdnTXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:01:24 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e82bf6c-f9d1-4b58-97fb-a52fc08d095c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:01:24 user nova-compute[75453]: No targets found.
Nov 28 14:01:24 user nova-compute[75453]: iSNS:
Nov 28 14:01:24 user nova-compute[75453]: No targets found.
Nov 28 14:01:24 user nova-compute[75453]: STATIC:
Nov 28 14:01:24 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:01:24 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:24 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:24 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:01:24 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:24 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:24 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 14:01:24 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:24 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:24 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373
Nov 28 14:01:24 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:24 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:24 user nova-compute[75453]: FIRMWARE:
Nov 28 14:01:24 user nova-compute[75453]: No targets found.
Nov 28 14:01:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:01:24 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:01:24 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae27faa-4b60-4d50-95fa-9712a4fa9416]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c677e45-67a6-47ce-b7b2-3f6a0fd66d24]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:24 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:01:24 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:24 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:24 user nova-compute[75453]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 (non-flash)
Nov 28 14:01:24 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:24 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c611480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373'): ({'sdd'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Removing single pathed devices sdd {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e2d56c-8fd2-4ba8-afe9-4e91da6c51d5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e92af5-7dcb-4995-986e-ef45b8beec13]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flushing IO for device /dev/sdd {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[79903083-7470-4909-be2e-81ec944d280d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:01:24 user nova-compute[75453]: INFO nova.compute.manager [None req-1a41b22d-40eb-47c2-af2e-460ad94ee834 tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance to original state: 'active'
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecd19cb-7afd-4159-a332-26851c1ab51b]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[21129b5f-87a7-465a-bdfe-169d789414a0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c83e8cf-21ea-413b-bb58-760ec5f5dccd]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260]
Nov 28 14:01:24 user nova-compute[75453]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373, portal: 172.16.0.220,3260] successful.
Nov 28 14:01:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6dd3f41-6624-4976-8316-6d52ce2c4373 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[08326f01-10eb-4dcf-9f46-d5d30023d4f8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== disconnect_volume: return (408ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:01:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:01:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:25 user nova-compute[75453]: DEBUG nova.objects.instance [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:01:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-06e82899-dedd-4cd6-bc42-50f987c3f669 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.035s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.440s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:26 user nova-compute[75453]: WARNING nova.compute.manager [req-2f3589ad-b36e-4941-9930-f90eb7877d9c req-903b79ee-1b8f-4049-841f-4e6e350f0329 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state active and task_state None.
Nov 28 14:01:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75453) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG nova.objects.instance [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance destroyed successfully.
Nov 28 14:01:27 user nova-compute[75453]: DEBUG nova.compute.manager [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:01:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cfdec949-8d14-4735-92de-b7af71e28305 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.020s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:28 user nova-compute[75453]: WARNING nova.compute.manager [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state active and task_state None.
Nov 28 14:01:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-unplugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-unplugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:28 user nova-compute[75453]: WARNING nova.compute.manager [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-unplugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state stopped and task_state None.
Nov 28 14:01:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:28 user nova-compute[75453]: WARNING nova.compute.manager [req-a0b90882-898b-4b96-9d29-8c6c51f46d10 req-b167fb02-f1a6-4672-8c41-24ca3d0eddc7 service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state stopped and task_state None.
Nov 28 14:01:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:34 user nova-compute[75453]: INFO nova.compute.manager [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Terminating instance
Nov 28 14:01:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received event network-vif-unplugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] No waiting events found dispatching network-vif-unplugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-8898aa70-65af-4e40-b49f-bcb88f3231bb req-4b03da83-9a1f-40e6-bf62-3332d64e7e63 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received event network-vif-unplugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:01:34 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Instance destroyed successfully.
Nov 28 14:01:34 user nova-compute[75453]: DEBUG nova.objects.instance [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lazy-loading 'resources' on Instance uuid 66c010a7-3604-41c4-9599-d41172a28fe2 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1507271553',display_name='tempest-TestVolumeSwap-server-1507271553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1507271553',id=7,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWrRYCdiugZ/CtrXqVD7eb5gUF2aQeZcK+0n7VM+NPSH+J/LVpNX8a1nsI34ZJBupBnzclrmU9wWLa+aW6mmPWCfOw3jkfYnl2HBeR1euPFYe3X7kvXFSQTwgf/TwJkNA==',key_name='tempest-keypair-888199441',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b65587be998440ed8f615dcb2f8f0d97',ramdisk_id='',reservation_id='r-7cwjsgwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2093360749',owner_user_name='tempest-TestVolumeSwap-2093360749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecf1fd2414db4fb9a5006cc8f5441745',uuid=66c010a7-3604-41c4-9599-d41172a28fe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Converting VIF {"id": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "address": "fa:16:3e:97:64:75", "network": {"id": "6ed64d27-5b2e-4ac9-be8f-4e65a223f220", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1532318914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b65587be998440ed8f615dcb2f8f0d97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4690b3-7d", "ovs_interfaceid": "1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:64:75,bridge_name='br-int',has_traffic_filtering=True,id=1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e,network=Network(6ed64d27-5b2e-4ac9-be8f-4e65a223f220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4690b3-7d') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_vif [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:64:75,bridge_name='br-int',has_traffic_filtering=True,id=1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e,network=Network(6ed64d27-5b2e-4ac9-be8f-4e65a223f220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4690b3-7d') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f4690b3-7d, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90721f49-6660-4a9e-a198-9f914ad41ca9) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:35 user nova-compute[75453]: INFO os_vif [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:64:75,bridge_name='br-int',has_traffic_filtering=True,id=1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e,network=Network(6ed64d27-5b2e-4ac9-be8f-4e65a223f220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4690b3-7d')
Nov 28 14:01:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMZbITkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'f4e3b65a-e2e0-4261-8f67-f4b561ad120c'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:01:35 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba73bf-8f3e-478a-ac28-8c129684f42e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:01:35 user nova-compute[75453]: No targets found.
Nov 28 14:01:35 user nova-compute[75453]: iSNS:
Nov 28 14:01:35 user nova-compute[75453]: No targets found.
Nov 28 14:01:35 user nova-compute[75453]: STATIC:
Nov 28 14:01:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:01:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:01:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c
Nov 28 14:01:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:01:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:01:35 user nova-compute[75453]: FIRMWARE:
Nov 28 14:01:35 user nova-compute[75453]: No targets found.
Nov 28 14:01:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:01:35 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:01:35 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6120d9e7-b39d-4c11-999a-d1dd6c880d51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a990e3-444b-47e2-b727-06996c2fdc64]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:35 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:35 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c (non-flash)
Nov 28 14:01:35 user nova-compute[75453]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:35 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f025416f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c'): ({'sdm'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Removing single pathed devices sdm {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8160bb16-03f0-4cba-8901-4a1ce7137d74]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[404e5237-f621-4a6c-b53c-e91ac66b4b9e]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Flushing IO for device /dev/sdm {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8376f7d8-f663-4e61-a26b-eb1402c3098b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.042s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2abc180-802c-4655-9299-ac03ca505111]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] SCSI volumes sdm have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a70e76-12dd-48f5-8811-b1d8e4777339]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7abcc7-8441-4ddb-9b97-f3f7edd4eb21]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c, portal: 172.16.0.220,3260]
Nov 28 14:01:35 user nova-compute[75453]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c, portal: 172.16.0.220,3260] successful.
Nov 28 14:01:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4e3b65a-e2e0-4261-8f67-f4b561ad120c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa2f79d-cea3-465c-9490-21250efadfb0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] <== disconnect_volume: return (329ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:01:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Deleting instance files /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2_del
Nov 28 14:01:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Deletion of /opt/stack/data/nova/instances/66c010a7-3604-41c4-9599-d41172a28fe2_del complete
Nov 28 14:01:35 user nova-compute[75453]: INFO nova.compute.manager [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 28 14:01:35 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:01:35 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:01:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received event network-vif-plugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] Acquiring lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] Lock "66c010a7-3604-41c4-9599-d41172a28fe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] No waiting events found dispatching network-vif-plugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:36 user nova-compute[75453]: WARNING nova.compute.manager [req-e9636916-13be-461c-ae64-c44eb4df93b9 req-c62310c3-2df9-48e2-8446-141a65507661 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received unexpected event network-vif-plugged-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e for instance with vm_state active and task_state deleting.
Nov 28 14:01:36 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:01:36 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Took 1.25 seconds to deallocate network for instance.
Nov 28 14:01:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:01:37 user nova-compute[75453]: INFO nova.compute.claims [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Claim successful on node user
Nov 28 14:01:37 user nova-compute[75453]: INFO nova.compute.manager [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Took 0.89 seconds to detach 1 volumes for instance.
Nov 28 14:01:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.205s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:01:37 user nova-compute[75453]: DEBUG nova.network.neutron [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:01:37 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:01:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG nova.policy [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f9c41c5c12e4ce0b5848dc319ceff1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5606d16b2f44aa0a189a0b20d687cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:01:38 user nova-compute[75453]: INFO nova.virt.block_device [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Booting with volume f30f0930-b3ec-4e8d-99ae-cd205eb43c59 at /dev/vda
Nov 28 14:01:38 user nova-compute[75453]: DEBUG os_brick.utils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7ab8cc-1332-4819-a444-bcbff79d93b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c093edf1-1c8b-4a48-b996-ff4291cf840b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb2a868-4b49-4915-af19-8d0cd78ca7c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b01d937-e775-4177-9982-4580b060ed78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:01:38 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd71e055-3ba1-47de-acf7-78c172cf21fb]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG os_brick.utils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating existing volume attachment record: 87e3d19c-8b37-4ed1-b51e-dc79d270c24f {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:38 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Deleted allocations for instance 66c010a7-3604-41c4-9599-d41172a28fe2
Nov 28 14:01:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a5ab5475-1e35-4d03-a8b9-5ada91c3bfdf tempest-TestVolumeSwap-2093360749 tempest-TestVolumeSwap-2093360749-project-member] Lock "66c010a7-3604-41c4-9599-d41172a28fe2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.280s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-c8083625-bae5-4879-8ff7-fb0d1a16ea63 req-1faa640f-608d-4d5d-9c88-443b47364e05 service nova] [instance: 66c010a7-3604-41c4-9599-d41172a28fe2] Received event network-vif-deleted-1f4690b3-7dca-4a6a-a5e1-7ec5a3279a7e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:38 user nova-compute[75453]: DEBUG nova.network.neutron [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Successfully created port: 36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:01:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Successfully updated port: 36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:01:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:01:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquired lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:01:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:01:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:01:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:01:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Releasing lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:01:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Instance network_info: |[{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:01:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:40 user nova-compute[75453]: DEBUG nova.compute.manager [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:40 user nova-compute[75453]: DEBUG nova.compute.manager [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing instance network info cache due to event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:01:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] Acquiring lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:01:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] Acquired lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:01:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:01:41 user nova-compute[75453]: DEBUG nova.network.neutron [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updated VIF entry in instance network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:01:41 user nova-compute[75453]: DEBUG nova.network.neutron [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:01:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b138e99e-7777-4592-991e-3df8fbba4c15 req-408fb511-dceb-4989-bdc5-342628003dd7 service nova] Releasing lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:01:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:01:45 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Creating image(s)
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Ensure instance console log exists: /opt/stack/data/nova/instances/807c145e-9d41-4a76-8777-c033276ba96a/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Start _get_guest_xml network_info=[{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '87e3d19c-8b37-4ed1-b51e-dc79d270c24f', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPxhjlQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '807c145e-9d41-4a76-8777-c033276ba96a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'serial': 'f30f0930-b3ec-4e8d-99ae-cd205eb43c59'}, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:01:45 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:01:45 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPxhjlQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:01:45 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:01:45 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:01:45 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b06c63-f1f6-48cd-a3aa-4a3146819cf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:01:45 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[806cfcc7-2269-44e9-8376-8cde6f41334c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59] added
Nov 28 14:01:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfa5c30-28c2-4622-9df6-3d958ca716b7]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f6128d-1a74-431f-85fa-821e1d72e741]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPxhjlQX {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPxhjlQX" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a4d704-d3fa-4097-a378-d01d2809264d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RPxhjlQX'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5710be-c9ef-405a-874b-3fc4b3db1a3a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3538f5f7-d3ae-4d2b-aec1-4c9832e42ad0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e461b5-9711-4431-b77a-d81fcf979c7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260]
Nov 28 14:01:45 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260] successful.
Nov 28 14:01:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[327b88f7-6b9c-4475-b60e-0e80cb2a1135]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d24d7e-ee5e-4547-b6fe-32f0f6cc20dc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:01:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[448e8781-1359-4fdf-b7fc-a83f3904897e]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:01:45 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPxhjlQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23861303463623234', 'path': '/dev/sdd'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861303463623234', 'path': '/dev/sdd'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023395681',display_name='tempest-TestShelveInstance-server-1023395681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023395681',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6z3du+pmuEBKboST02586Of9o2SE842jAb049GFnMxRW83rmvet7dpNb4t0VRkhFGxC/tIx+XacRSvu0RJvjpQharev3k6UhzGalKPyeiOSo5afml9y35O1EfkG0ODGQ==',key_name='tempest-TestShelveInstance-1470109784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5606d16b2f44aa0a189a0b20d687cbc',ramdisk_id='',reservation_id='r-00jaku0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-511272115',owner_user_name='tempest-TestShelveInstance-511272115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:01:38Z,user_data=None,user_id='6f9c41c5c12e4ce0b5848dc319ceff1d',uuid=807c145e-9d41-4a76-8777-c033276ba96a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converting VIF {"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.objects.instance [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lazy-loading 'pci_devices' on Instance uuid 807c145e-9d41-4a76-8777-c033276ba96a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:01:46 user nova-compute[75453]:   <uuid>807c145e-9d41-4a76-8777-c033276ba96a</uuid>
Nov 28 14:01:46 user nova-compute[75453]:   <name>instance-00000013</name>
Nov 28 14:01:46 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:01:46 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:01:46 user nova-compute[75453]:   <metadata>
Nov 28 14:01:46 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:01:46 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:01:46 user nova-compute[75453]:       <nova:name>tempest-TestShelveInstance-server-1023395681</nova:name>
Nov 28 14:01:46 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:01:45</nova:creationTime>
Nov 28 14:01:46 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:01:46 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:01:46 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:01:46 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:01:46 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:01:46 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:01:46 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:01:46 user nova-compute[75453]:       <nova:owner>
Nov 28 14:01:46 user nova-compute[75453]:         <nova:user uuid="6f9c41c5c12e4ce0b5848dc319ceff1d">tempest-TestShelveInstance-511272115-project-member</nova:user>
Nov 28 14:01:46 user nova-compute[75453]:         <nova:project uuid="d5606d16b2f44aa0a189a0b20d687cbc">tempest-TestShelveInstance-511272115</nova:project>
Nov 28 14:01:46 user nova-compute[75453]:       </nova:owner>
Nov 28 14:01:46 user nova-compute[75453]:       <nova:ports>
Nov 28 14:01:46 user nova-compute[75453]:         <nova:port uuid="36fe7f7b-64c5-47bd-815b-b61516ad2167">
Nov 28 14:01:46 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 14:01:46 user nova-compute[75453]:         </nova:port>
Nov 28 14:01:46 user nova-compute[75453]:       </nova:ports>
Nov 28 14:01:46 user nova-compute[75453]:     </nova:instance>
Nov 28 14:01:46 user nova-compute[75453]:   </metadata>
Nov 28 14:01:46 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:01:46 user nova-compute[75453]:     <system>
Nov 28 14:01:46 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:01:46 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:01:46 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:01:46 user nova-compute[75453]:       <entry name="serial">807c145e-9d41-4a76-8777-c033276ba96a</entry>
Nov 28 14:01:46 user nova-compute[75453]:       <entry name="uuid">807c145e-9d41-4a76-8777-c033276ba96a</entry>
Nov 28 14:01:46 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:01:46 user nova-compute[75453]:     </system>
Nov 28 14:01:46 user nova-compute[75453]:   </sysinfo>
Nov 28 14:01:46 user nova-compute[75453]:   <os>
Nov 28 14:01:46 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:01:46 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:01:46 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:01:46 user nova-compute[75453]:   </os>
Nov 28 14:01:46 user nova-compute[75453]:   <features>
Nov 28 14:01:46 user nova-compute[75453]:     <acpi/>
Nov 28 14:01:46 user nova-compute[75453]:     <apic/>
Nov 28 14:01:46 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:01:46 user nova-compute[75453]:   </features>
Nov 28 14:01:46 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:01:46 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:01:46 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:01:46 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:01:46 user nova-compute[75453]:   </clock>
Nov 28 14:01:46 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:01:46 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:01:46 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:01:46 user nova-compute[75453]:   </cpu>
Nov 28 14:01:46 user nova-compute[75453]:   <devices>
Nov 28 14:01:46 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:01:46 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:01:46 user nova-compute[75453]:       <source dev="/dev/sdd"/>
Nov 28 14:01:46 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:01:46 user nova-compute[75453]:       <serial>f30f0930-b3ec-4e8d-99ae-cd205eb43c59</serial>
Nov 28 14:01:46 user nova-compute[75453]:     </disk>
Nov 28 14:01:46 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:01:46 user nova-compute[75453]:       <mac address="fa:16:3e:36:e4:41"/>
Nov 28 14:01:46 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:01:46 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:01:46 user nova-compute[75453]:       <target dev="tap36fe7f7b-64"/>
Nov 28 14:01:46 user nova-compute[75453]:     </interface>
Nov 28 14:01:46 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:01:46 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/807c145e-9d41-4a76-8777-c033276ba96a/console.log" append="off"/>
Nov 28 14:01:46 user nova-compute[75453]:     </serial>
Nov 28 14:01:46 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:01:46 user nova-compute[75453]:     <video>
Nov 28 14:01:46 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:01:46 user nova-compute[75453]:     </video>
Nov 28 14:01:46 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:01:46 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:01:46 user nova-compute[75453]:     </rng>
Nov 28 14:01:46 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:01:46 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:01:46 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:01:46 user nova-compute[75453]:     </memballoon>
Nov 28 14:01:46 user nova-compute[75453]:   </devices>
Nov 28 14:01:46 user nova-compute[75453]: </domain>
Nov 28 14:01:46 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023395681',display_name='tempest-TestShelveInstance-server-1023395681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023395681',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6z3du+pmuEBKboST02586Of9o2SE842jAb049GFnMxRW83rmvet7dpNb4t0VRkhFGxC/tIx+XacRSvu0RJvjpQharev3k6UhzGalKPyeiOSo5afml9y35O1EfkG0ODGQ==',key_name='tempest-TestShelveInstance-1470109784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5606d16b2f44aa0a189a0b20d687cbc',ramdisk_id='',reservation_id='r-00jaku0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-511272115',owner_user_name='tempest-TestShelveInstance-511272115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:01:38Z,user_data=None,user_id='6f9c41c5c12e4ce0b5848dc319ceff1d',uuid=807c145e-9d41-4a76-8777-c033276ba96a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converting VIF {"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG os_vif [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ed80408-002c-52e2-9fbd-5e4f18642f35', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36fe7f7b-64, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36fe7f7b-64, col_values=(('qos', UUID('500381b3-adea-41c3-96a1-a570d39fa7e7')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36fe7f7b-64, col_values=(('external_ids', {'iface-id': '36fe7f7b-64c5-47bd-815b-b61516ad2167', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:e4:41', 'vm-uuid': '807c145e-9d41-4a76-8777-c033276ba96a'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:46 user nova-compute[75453]: INFO os_vif [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64')
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:01:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] No VIF found with MAC fa:16:3e:36:e4:41, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:01:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] No waiting events found dispatching network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:48 user nova-compute[75453]: WARNING nova.compute.manager [req-a4a9d954-230d-41f4-9a9d-fffd996b6c76 req-2c1d9530-1686-4584-b0b8-f300dd0c9f3d service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received unexpected event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance with vm_state building and task_state spawning.
Nov 28 14:01:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:01:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Instance spawned successfully.
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:01:50 user nova-compute[75453]: INFO nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] No waiting events found dispatching network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:01:50 user nova-compute[75453]: WARNING nova.compute.manager [req-9602a730-4244-4c94-bbc4-0b2bcde04361 req-6db4baeb-3a0d-45ec-87ac-6d09181b42f7 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received unexpected event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance with vm_state building and task_state spawning.
Nov 28 14:01:50 user nova-compute[75453]: INFO nova.compute.manager [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Took 13.01 seconds to build instance.
Nov 28 14:01:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a63fc581-62a9-4a4a-8890-77c2b06bc61f tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.124s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "3aa772d7-ca30-4a90-b326-3450f9e28784" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:01:59 user nova-compute[75453]: INFO nova.compute.claims [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Claim successful on node user
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:01:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.policy [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:01:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Creating image(s)
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "/opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "/opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "/opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk 1073741824" returned: 0 in 0.048s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Successfully created port: d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Cannot resize image /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Ensure instance console log exists: /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Successfully updated port: d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "refresh_cache-3aa772d7-ca30-4a90-b326-3450f9e28784" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquired lock "refresh_cache-3aa772d7-ca30-4a90-b326-3450f9e28784" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Received event network-changed-d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Refreshing instance network info cache due to event network-changed-d38482f3-db24-4172-a831-de471ef45c2b. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] Acquiring lock "refresh_cache-3aa772d7-ca30-4a90-b326-3450f9e28784" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Updating instance_info_cache with network_info: [{"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Releasing lock "refresh_cache-3aa772d7-ca30-4a90-b326-3450f9e28784" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Instance network_info: |[{"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] Acquired lock "refresh_cache-3aa772d7-ca30-4a90-b326-3450f9e28784" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.neutron [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Refreshing network info cache for port d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Start _get_guest_xml network_info=[{"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:02:01 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:02:01 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1926298954',display_name='tempest-AttachVolumeNegativeTest-server-1926298954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1926298954',id=20,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgIoKRVSV5nMNqKEgIQf0W5MKotAydNA66TSyhlYX6P4EK7Qo0KESqOWiHQOWd4ZAUh5eftROfsJT5+OoKZQ8vCa3ADu1/YgEh40c7+yO222qyd2ZPAI5I1imtXJod6iA==',key_name='tempest-keypair-1356044097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-jgomz4a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=3aa772d7-ca30-4a90-b326-3450f9e28784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:52,bridge_name='br-int',has_traffic_filtering=True,id=d38482f3-db24-4172-a831-de471ef45c2b,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38482f3-db') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.objects.instance [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'pci_devices' on Instance uuid 3aa772d7-ca30-4a90-b326-3450f9e28784 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:02:01 user nova-compute[75453]:   <uuid>3aa772d7-ca30-4a90-b326-3450f9e28784</uuid>
Nov 28 14:02:01 user nova-compute[75453]:   <name>instance-00000014</name>
Nov 28 14:02:01 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:02:01 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:02:01 user nova-compute[75453]:   <metadata>
Nov 28 14:02:01 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:02:01 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:02:01 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1926298954</nova:name>
Nov 28 14:02:01 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:02:01</nova:creationTime>
Nov 28 14:02:01 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:02:01 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:02:01 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:02:01 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:02:01 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:02:01 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:02:01 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:02:01 user nova-compute[75453]:       <nova:owner>
Nov 28 14:02:01 user nova-compute[75453]:         <nova:user uuid="2afdefdd832241779d405f4763c3b37e">tempest-AttachVolumeNegativeTest-180653455-project-member</nova:user>
Nov 28 14:02:01 user nova-compute[75453]:         <nova:project uuid="b710669f2d5c41378e2c63765f2846ed">tempest-AttachVolumeNegativeTest-180653455</nova:project>
Nov 28 14:02:01 user nova-compute[75453]:       </nova:owner>
Nov 28 14:02:01 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:02:01 user nova-compute[75453]:       <nova:ports>
Nov 28 14:02:01 user nova-compute[75453]:         <nova:port uuid="d38482f3-db24-4172-a831-de471ef45c2b">
Nov 28 14:02:01 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:02:01 user nova-compute[75453]:         </nova:port>
Nov 28 14:02:01 user nova-compute[75453]:       </nova:ports>
Nov 28 14:02:01 user nova-compute[75453]:     </nova:instance>
Nov 28 14:02:01 user nova-compute[75453]:   </metadata>
Nov 28 14:02:01 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:02:01 user nova-compute[75453]:     <system>
Nov 28 14:02:01 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:02:01 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:02:01 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:02:01 user nova-compute[75453]:       <entry name="serial">3aa772d7-ca30-4a90-b326-3450f9e28784</entry>
Nov 28 14:02:01 user nova-compute[75453]:       <entry name="uuid">3aa772d7-ca30-4a90-b326-3450f9e28784</entry>
Nov 28 14:02:01 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:02:01 user nova-compute[75453]:     </system>
Nov 28 14:02:01 user nova-compute[75453]:   </sysinfo>
Nov 28 14:02:01 user nova-compute[75453]:   <os>
Nov 28 14:02:01 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:02:01 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:02:01 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:02:01 user nova-compute[75453]:   </os>
Nov 28 14:02:01 user nova-compute[75453]:   <features>
Nov 28 14:02:01 user nova-compute[75453]:     <acpi/>
Nov 28 14:02:01 user nova-compute[75453]:     <apic/>
Nov 28 14:02:01 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:02:01 user nova-compute[75453]:   </features>
Nov 28 14:02:01 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:02:01 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:02:01 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:02:01 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:02:01 user nova-compute[75453]:   </clock>
Nov 28 14:02:01 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:02:01 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:02:01 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:02:01 user nova-compute[75453]:   </cpu>
Nov 28 14:02:01 user nova-compute[75453]:   <devices>
Nov 28 14:02:01 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:02:01 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:02:01 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk"/>
Nov 28 14:02:01 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:02:01 user nova-compute[75453]:     </disk>
Nov 28 14:02:01 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:02:01 user nova-compute[75453]:       <mac address="fa:16:3e:e3:e9:52"/>
Nov 28 14:02:01 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:02:01 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:02:01 user nova-compute[75453]:       <target dev="tapd38482f3-db"/>
Nov 28 14:02:01 user nova-compute[75453]:     </interface>
Nov 28 14:02:01 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:02:01 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/console.log" append="off"/>
Nov 28 14:02:01 user nova-compute[75453]:     </serial>
Nov 28 14:02:01 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:02:01 user nova-compute[75453]:     <video>
Nov 28 14:02:01 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:02:01 user nova-compute[75453]:     </video>
Nov 28 14:02:01 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:02:01 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:02:01 user nova-compute[75453]:     </rng>
Nov 28 14:02:01 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:02:01 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:02:01 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:02:01 user nova-compute[75453]:     </memballoon>
Nov 28 14:02:01 user nova-compute[75453]:   </devices>
Nov 28 14:02:01 user nova-compute[75453]: </domain>
Nov 28 14:02:01 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1926298954',display_name='tempest-AttachVolumeNegativeTest-server-1926298954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1926298954',id=20,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgIoKRVSV5nMNqKEgIQf0W5MKotAydNA66TSyhlYX6P4EK7Qo0KESqOWiHQOWd4ZAUh5eftROfsJT5+OoKZQ8vCa3ADu1/YgEh40c7+yO222qyd2ZPAI5I1imtXJod6iA==',key_name='tempest-keypair-1356044097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-jgomz4a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=3aa772d7-ca30-4a90-b326-3450f9e28784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:52,bridge_name='br-int',has_traffic_filtering=True,id=d38482f3-db24-4172-a831-de471ef45c2b,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38482f3-db') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG os_vif [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:52,bridge_name='br-int',has_traffic_filtering=True,id=d38482f3-db24-4172-a831-de471ef45c2b,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38482f3-db') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '497034fb-4e49-5f0d-b43e-8464acedc357', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd38482f3-db, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd38482f3-db, col_values=(('qos', UUID('e28928aa-77e1-4af1-93dc-12fa71c3e93f')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd38482f3-db, col_values=(('external_ids', {'iface-id': 'd38482f3-db24-4172-a831-de471ef45c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:e9:52', 'vm-uuid': '3aa772d7-ca30-4a90-b326-3450f9e28784'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:01 user nova-compute[75453]: INFO os_vif [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e9:52,bridge_name='br-int',has_traffic_filtering=True,id=d38482f3-db24-4172-a831-de471ef45c2b,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38482f3-db')
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No VIF found with MAC fa:16:3e:e3:e9:52, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.neutron [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Updated VIF entry in instance network info cache for port d38482f3-db24-4172-a831-de471ef45c2b. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG nova.network.neutron [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Updating instance_info_cache with network_info: [{"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-243d42ed-dc88-412a-bed9-c6100e31e732 req-be355a2a-ee88-43b2-9728-472daf9dea11 service nova] Releasing lock "refresh_cache-3aa772d7-ca30-4a90-b326-3450f9e28784" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Received event network-vif-plugged-d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] Acquiring lock "3aa772d7-ca30-4a90-b326-3450f9e28784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] No waiting events found dispatching network-vif-plugged-d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:03 user nova-compute[75453]: WARNING nova.compute.manager [req-f4666b0e-1ff2-4db7-bf4a-9ebc1503ea61 req-aed7d541-f1f9-4c39-b70b-7248f756a512 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Received unexpected event network-vif-plugged-d38482f3-db24-4172-a831-de471ef45c2b for instance with vm_state building and task_state spawning.
Nov 28 14:02:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:02:05 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Instance spawned successfully.
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Received event network-vif-plugged-d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] Acquiring lock "3aa772d7-ca30-4a90-b326-3450f9e28784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] No waiting events found dispatching network-vif-plugged-d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:05 user nova-compute[75453]: WARNING nova.compute.manager [req-78ffee68-e348-4721-9bc7-7248e4b03019 req-a5d04274-b541-4675-91fe-719abcd24982 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Received unexpected event network-vif-plugged-d38482f3-db24-4172-a831-de471ef45c2b for instance with vm_state building and task_state spawning.
Nov 28 14:02:05 user nova-compute[75453]: INFO nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 28 14:02:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:02:05 user nova-compute[75453]: INFO nova.compute.manager [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Took 6.37 seconds to build instance.
Nov 28 14:02:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4f494068-77af-4972-94e1-ed5b39d8eb45 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.478s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:07 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:02:09 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:02:09 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7709MB free_disk=25.375476837158203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 48dd0221-4935-4ee2-9958-90a748fe5255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance ea32aeb2-975a-4295-aeb6-12e177657219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 6466bc94-8a78-4541-a864-9f0370b212c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 807c145e-9d41-4a76-8777-c033276ba96a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 3aa772d7-ca30-4a90-b326-3450f9e28784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:02:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:02:10 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:02:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:02:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:02:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:02:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:02:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:02:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:02:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:02:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:14 user nova-compute[75453]: DEBUG nova.compute.manager [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received event network-changed-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:14 user nova-compute[75453]: DEBUG nova.compute.manager [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Refreshing instance network info cache due to event network-changed-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:02:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] Acquiring lock "refresh_cache-1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] Acquired lock "refresh_cache-1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:14 user nova-compute[75453]: DEBUG nova.network.neutron [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Refreshing network info cache for port e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:02:14 user nova-compute[75453]: DEBUG nova.network.neutron [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Updated VIF entry in instance network info cache for port e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:02:14 user nova-compute[75453]: DEBUG nova.network.neutron [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Updating instance_info_cache with network_info: [{"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ff022b9d-8d9a-4f38-8a92-7a51eab0b803 req-f49b12b2-1136-479d-8207-7a2eb6d3a06d service nova] Releasing lock "refresh_cache-1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:17 user nova-compute[75453]: INFO nova.compute.manager [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Attaching volume 4dfd2051-f1a1-44d0-967f-cfab350bd0ca to /dev/sdc
Nov 28 14:02:17 user nova-compute[75453]: DEBUG os_brick.utils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01a87b0-4b0f-4cbc-b5fc-fc46d9c95f01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a595118b-3110-471c-893c-4e7a60105e54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7272c45-9d97-4e4c-827c-1b7c0dbb7e00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bcf578-2e1b-4003-8064-6bb1aed9c68e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:02:17 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:02:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82d399f-37bc-4005-bb40-bff649db2763]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG os_brick.utils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:17 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Updating existing volume attachment record: ac559393-7d23-4ede-bce0-873c9330074f {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:02:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "2d3e50a0-3428-42c7-aee0-baa85761b734" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:02:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:23 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:02:23 user nova-compute[75453]: INFO nova.compute.claims [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Claim successful on node user
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:02:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.policy [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f72e0ee68948479fa09697af3cf24b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cec039db477464e97d27271375d7787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:02:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Creating image(s)
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "/opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "/opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk 1073741824" returned: 0 in 0.049s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Successfully created port: af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:02:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Cannot resize image /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Ensure instance console log exists: /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsQFOlmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:25 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:02:25 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:02:25 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c5c20b-3242-4345-91c5-823b22f6a351]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:02:25 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[980ba545-d847-4b31-a5f5-777bebc17d26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca] added
Nov 28 14:02:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4353d01b-e5ef-4d9f-9cd9-5345abb5765e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[418aaeb1-d9a7-48e6-b5f9-9cea9df99db9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsQFOlmj {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsQFOlmj" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e284e061-8b65-4ac3-80af-f01de2efa0d1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vsQFOlmj'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed79b94b-e073-4a16-a127-eee5c19f49cd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[43602d1e-6388-406e-9d19-d847e1e95b52]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a3084-684a-4db3-a44d-6ef22fb67d02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca, portal: 172.16.0.220,3260]
Nov 28 14:02:25 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca, portal: 172.16.0.220,3260] successful.
Nov 28 14:02:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e630a7e8-7fc7-4c52-8149-183166cbca2b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b49308f-b678-44c4-8547-9709a130ae79]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:25 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[008f00b3-f522-4ea7-8911-4cc130d0338b]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsQFOlmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Successfully updated port: af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "refresh_cache-2d3e50a0-3428-42c7-aee0-baa85761b734" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquired lock "refresh_cache-2d3e50a0-3428-42c7-aee0-baa85761b734" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received event network-changed-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Refreshing instance network info cache due to event network-changed-af80811d-0d53-4367-88e4-0a688c183350. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] Acquiring lock "refresh_cache-2d3e50a0-3428-42c7-aee0-baa85761b734" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Updating instance_info_cache with network_info: [{"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Releasing lock "refresh_cache-2d3e50a0-3428-42c7-aee0-baa85761b734" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Instance network_info: |[{"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] Acquired lock "refresh_cache-2d3e50a0-3428-42c7-aee0-baa85761b734" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.network.neutron [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Refreshing network info cache for port af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Start _get_guest_xml network_info=[{"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:02:25 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:02:25 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1739476838',display_name='tempest-DeleteServersTestJSON-server-1739476838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1739476838',id=21,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cec039db477464e97d27271375d7787',ramdisk_id='',reservation_id='r-f9y1no7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-283705446',owner_user_name='tempest-DeleteServersTestJSON-283705446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:24Z,user_data=None,user_id='f72e0ee68948479fa09697af3cf24b4b',uuid=2d3e50a0-3428-42c7-aee0-baa85761b734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Converting VIF {"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=af80811d-0d53-4367-88e4-0a688c183350,network=Network(8b43f52b-7c66-43d0-a042-a7cbace5ffcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf80811d-0d') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.objects.instance [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d3e50a0-3428-42c7-aee0-baa85761b734 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:02:25 user nova-compute[75453]:   <uuid>2d3e50a0-3428-42c7-aee0-baa85761b734</uuid>
Nov 28 14:02:25 user nova-compute[75453]:   <name>instance-00000015</name>
Nov 28 14:02:25 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:02:25 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:02:25 user nova-compute[75453]:   <metadata>
Nov 28 14:02:25 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:02:25 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:02:25 user nova-compute[75453]:       <nova:name>tempest-DeleteServersTestJSON-server-1739476838</nova:name>
Nov 28 14:02:25 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:02:25</nova:creationTime>
Nov 28 14:02:25 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:02:25 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:02:25 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:02:25 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:02:25 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:02:25 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:02:25 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:02:25 user nova-compute[75453]:       <nova:owner>
Nov 28 14:02:25 user nova-compute[75453]:         <nova:user uuid="f72e0ee68948479fa09697af3cf24b4b">tempest-DeleteServersTestJSON-283705446-project-member</nova:user>
Nov 28 14:02:25 user nova-compute[75453]:         <nova:project uuid="5cec039db477464e97d27271375d7787">tempest-DeleteServersTestJSON-283705446</nova:project>
Nov 28 14:02:25 user nova-compute[75453]:       </nova:owner>
Nov 28 14:02:25 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:02:25 user nova-compute[75453]:       <nova:ports>
Nov 28 14:02:25 user nova-compute[75453]:         <nova:port uuid="af80811d-0d53-4367-88e4-0a688c183350">
Nov 28 14:02:25 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:02:25 user nova-compute[75453]:         </nova:port>
Nov 28 14:02:25 user nova-compute[75453]:       </nova:ports>
Nov 28 14:02:25 user nova-compute[75453]:     </nova:instance>
Nov 28 14:02:25 user nova-compute[75453]:   </metadata>
Nov 28 14:02:25 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:02:25 user nova-compute[75453]:     <system>
Nov 28 14:02:25 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:02:25 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:02:25 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:02:25 user nova-compute[75453]:       <entry name="serial">2d3e50a0-3428-42c7-aee0-baa85761b734</entry>
Nov 28 14:02:25 user nova-compute[75453]:       <entry name="uuid">2d3e50a0-3428-42c7-aee0-baa85761b734</entry>
Nov 28 14:02:25 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:02:25 user nova-compute[75453]:     </system>
Nov 28 14:02:25 user nova-compute[75453]:   </sysinfo>
Nov 28 14:02:25 user nova-compute[75453]:   <os>
Nov 28 14:02:25 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:02:25 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:02:25 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:02:25 user nova-compute[75453]:   </os>
Nov 28 14:02:25 user nova-compute[75453]:   <features>
Nov 28 14:02:25 user nova-compute[75453]:     <acpi/>
Nov 28 14:02:25 user nova-compute[75453]:     <apic/>
Nov 28 14:02:25 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:02:25 user nova-compute[75453]:   </features>
Nov 28 14:02:25 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:02:25 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:02:25 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:02:25 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:02:25 user nova-compute[75453]:   </clock>
Nov 28 14:02:25 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:02:25 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:02:25 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:02:25 user nova-compute[75453]:   </cpu>
Nov 28 14:02:25 user nova-compute[75453]:   <devices>
Nov 28 14:02:25 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:02:25 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:02:25 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk"/>
Nov 28 14:02:25 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:02:25 user nova-compute[75453]:     </disk>
Nov 28 14:02:25 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:02:25 user nova-compute[75453]:       <mac address="fa:16:3e:5d:4e:f2"/>
Nov 28 14:02:25 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:02:25 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:02:25 user nova-compute[75453]:       <target dev="tapaf80811d-0d"/>
Nov 28 14:02:25 user nova-compute[75453]:     </interface>
Nov 28 14:02:25 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:02:25 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/console.log" append="off"/>
Nov 28 14:02:25 user nova-compute[75453]:     </serial>
Nov 28 14:02:25 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:02:25 user nova-compute[75453]:     <video>
Nov 28 14:02:25 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:02:25 user nova-compute[75453]:     </video>
Nov 28 14:02:25 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:02:25 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:02:25 user nova-compute[75453]:     </rng>
Nov 28 14:02:25 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:02:25 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:02:25 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:02:25 user nova-compute[75453]:     </memballoon>
Nov 28 14:02:25 user nova-compute[75453]:   </devices>
Nov 28 14:02:25 user nova-compute[75453]: </domain>
Nov 28 14:02:25 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1739476838',display_name='tempest-DeleteServersTestJSON-server-1739476838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1739476838',id=21,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cec039db477464e97d27271375d7787',ramdisk_id='',reservation_id='r-f9y1no7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-283705446',owner_user_name='tempest-DeleteServersTestJSON-283705446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:24Z,user_data=None,user_id='f72e0ee68948479fa09697af3cf24b4b',uuid=2d3e50a0-3428-42c7-aee0-baa85761b734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Converting VIF {"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=af80811d-0d53-4367-88e4-0a688c183350,network=Network(8b43f52b-7c66-43d0-a042-a7cbace5ffcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf80811d-0d') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG os_vif [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=af80811d-0d53-4367-88e4-0a688c183350,network=Network(8b43f52b-7c66-43d0-a042-a7cbace5ffcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf80811d-0d') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '411bee21-d7ff-5545-b2b4-26c93620e423', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf80811d-0d, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf80811d-0d, col_values=(('qos', UUID('fa4dd2ad-887b-41d0-a35e-1004af3342fc')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf80811d-0d, col_values=(('external_ids', {'iface-id': 'af80811d-0d53-4367-88e4-0a688c183350', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:4e:f2', 'vm-uuid': '2d3e50a0-3428-42c7-aee0-baa85761b734'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:25 user nova-compute[75453]: INFO os_vif [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=af80811d-0d53-4367-88e4-0a688c183350,network=Network(8b43f52b-7c66-43d0-a042-a7cbace5ffcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf80811d-0d')
Nov 28 14:02:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] No VIF found with MAC fa:16:3e:5d:4e:f2, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:02:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Updated VIF entry in instance network info cache for port af80811d-0d53-4367-88e4-0a688c183350. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:02:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Updating instance_info_cache with network_info: [{"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cc7cd061-699d-4507-baba-1a205d6bd642 req-522c5ba9-5495-4093-bd24-71fe94365d7f service nova] Releasing lock "refresh_cache-2d3e50a0-3428-42c7-aee0-baa85761b734" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:02:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26432363032336430', 'path': '/dev/sde'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432363032336430', 'path': '/dev/sde'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:02:26 user nova-compute[75453]: DEBUG nova.objects.instance [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:02:26 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:02:26 user nova-compute[75453]:   <source dev="/dev/sde"/>
Nov 28 14:02:26 user nova-compute[75453]:   <target dev="sdc" bus="scsi"/>
Nov 28 14:02:26 user nova-compute[75453]:   <serial>4dfd2051-f1a1-44d0-967f-cfab350bd0ca</serial>
Nov 28 14:02:26 user nova-compute[75453]:   <address type="drive" controller="0" unit="2"/>
Nov 28 14:02:26 user nova-compute[75453]: </disk>
Nov 28 14:02:26 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] No BDM found with device name sda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] No VIF found with MAC fa:16:3e:de:ec:0f, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9dbcac71-7747-40e4-aaf7-25d2be366b18 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.276s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received event network-vif-plugged-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] Acquiring lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] No waiting events found dispatching network-vif-plugged-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:28 user nova-compute[75453]: WARNING nova.compute.manager [req-3a3b70ae-95c7-4665-9d6a-f0135af7f2a2 req-42a37a03-5788-4429-9f0c-1fcc12ebc93e service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received unexpected event network-vif-plugged-af80811d-0d53-4367-88e4-0a688c183350 for instance with vm_state building and task_state spawning.
Nov 28 14:02:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:28 user nova-compute[75453]: INFO nova.compute.manager [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Detaching volume 4dfd2051-f1a1-44d0-967f-cfab350bd0ca
Nov 28 14:02:28 user nova-compute[75453]: INFO nova.virt.block_device [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Attempting to driver detach volume 4dfd2051-f1a1-44d0-967f-cfab350bd0ca from mountpoint /dev/sdc
Nov 28 14:02:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Attempting to detach device sdc from instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:02:28 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:02:28 user nova-compute[75453]:   <source dev="/dev/sde"/>
Nov 28 14:02:28 user nova-compute[75453]:   <target dev="sdc" bus="scsi"/>
Nov 28 14:02:28 user nova-compute[75453]:   <serial>4dfd2051-f1a1-44d0-967f-cfab350bd0ca</serial>
Nov 28 14:02:28 user nova-compute[75453]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 14:02:28 user nova-compute[75453]: </disk>
Nov 28 14:02:28 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:02:28 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Successfully detached device sdc from instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d from the persistent domain config.
Nov 28 14:02:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:02:28 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:02:28 user nova-compute[75453]:   <source dev="/dev/sde"/>
Nov 28 14:02:28 user nova-compute[75453]:   <target dev="sdc" bus="scsi"/>
Nov 28 14:02:28 user nova-compute[75453]:   <serial>4dfd2051-f1a1-44d0-967f-cfab350bd0ca</serial>
Nov 28 14:02:28 user nova-compute[75453]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 14:02:28 user nova-compute[75453]: </disk>
Nov 28 14:02:28 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:02:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG nova.objects.instance [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'flavor' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:29 user nova-compute[75453]: INFO nova.compute.manager [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Attaching volume cb097930-0134-453a-bf8a-a77dbeabc8fa to /dev/vdb
Nov 28 14:02:29 user nova-compute[75453]: DEBUG os_brick.utils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[17344e1f-3a9d-4309-8e74-adadc8ec1498]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[513ddb55-6710-4271-baeb-4109e1786209]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8d5e83-a844-4c0b-8539-65df1e814ec6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[121f468e-022b-4943-80d5-467292307553]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:02:30 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59c6cf5-9a17-4e18-a33e-c1e3658edf8f]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.utils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating existing volume attachment record: 67de0bc0-cdb4-460f-9e30-4ad83ac12071 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:02:30 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Instance spawned successfully.
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received event network-vif-plugged-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Acquiring lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] No waiting events found dispatching network-vif-plugged-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:30 user nova-compute[75453]: WARNING nova.compute.manager [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received unexpected event network-vif-plugged-af80811d-0d53-4367-88e4-0a688c183350 for instance with vm_state building and task_state spawning.
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received event network-changed-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Refreshing instance network info cache due to event network-changed-c559881f-688d-4805-972f-470ba7cb0c3a. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Acquiring lock "refresh_cache-e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Acquired lock "refresh_cache-e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.network.neutron [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Refreshing network info cache for port c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:02:30 user nova-compute[75453]: INFO nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'flavor' on Instance uuid e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:30 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Ignoring supplied device name: /dev/vdb
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:30 user nova-compute[75453]: INFO nova.compute.manager [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Took 6.81 seconds to build instance.
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-27b71624-db4e-449e-bc59-c763298b27f0 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.913s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:30 user nova-compute[75453]: INFO nova.compute.manager [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Attaching volume ee665431-8646-4683-a0e1-c392d691e7ee to /dev/vdb
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.utils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dccc32-a808-4b73-912c-b1f70758668f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b720a4-27f0-415e-a3be-e69b1fc972c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43e0373-227a-463e-b24f-2f84d721e49e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b62c27c-dc7d-422d-9089-04d909c53e29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.network.neutron [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Updated VIF entry in instance network info cache for port c559881f-688d-4805-972f-470ba7cb0c3a. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.network.neutron [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Updating instance_info_cache with network_info: [{"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:02:30 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e6afc3-d883-48f2-a9b4-43e3000731f5]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG os_brick.utils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Updating existing volume attachment record: 1220ff64-1dc3-483d-bff8-587bf1089e7b {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66fc69f3-13df-470d-ac9c-edb2be491ae3 req-6a3441a2-5a83-43b3-ab8b-8cb18db7f50d service nova] Releasing lock "refresh_cache-e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-changed-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Refreshing instance network info cache due to event network-changed-f85d8e95-0038-4312-bfc1-28b0a2354a09. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:02:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] Acquiring lock "refresh_cache-6466bc94-8a78-4541-a864-9f0370b212c1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] Acquired lock "refresh_cache-6466bc94-8a78-4541-a864-9f0370b212c1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Refreshing network info cache for port f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:02:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Updated VIF entry in instance network info cache for port f85d8e95-0038-4312-bfc1-28b0a2354a09. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:02:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Updating instance_info_cache with network_info: [{"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d11c72a2-9acd-4fa3-9305-41f8a97d4cdd req-22e87c69-539e-49b2-824e-f5b67930e598 service nova] Releasing lock "refresh_cache-6466bc94-8a78-4541-a864-9f0370b212c1" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:33 user nova-compute[75453]: INFO nova.compute.manager [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Rebuilding instance
Nov 28 14:02:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:02:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-unplugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] No waiting events found dispatching network-vif-unplugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:34 user nova-compute[75453]: WARNING nova.compute.manager [req-7942cb7e-6005-4d31-ae08-441a71ffbcbf req-0eef98d0-c85f-48d2-8952-9240d7d5a636 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received unexpected event network-vif-unplugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance with vm_state active and task_state rebuilding.
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance destroyed successfully.
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance destroyed successfully.
Nov 28 14:02:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1664826618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1576957829',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCE1KdXUl0gyKQN8cxHdQBSdoIOXAXck9gShrFsDuTComCOmZg1HXlk/E0PRpSF3JI/duBB0wGIY1DEhRduzsv/cvgYCVHRukYUjTiF6VZpcGAYot9rGCCTrNA5JY+6g==',key_name='tempest-keypair-1958037787',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cbf581e03a6c4f678536c9d64fe4b8cc',ramdisk_id='',reservation_id='r-le3gxts7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2097640131',owner_user_name='tempest-ServerActionsV293TestJSON-2097640131-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1406382a40d841b5a59d791ec6744fc4',uuid=6466bc94-8a78-4541-a864-9f0370b212c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converting VIF {"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_vif [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf85d8e95-00, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40651a9f-96db-4ec9-9d32-9c15490a26ee) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:34 user nova-compute[75453]: INFO os_vif [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00')
Nov 28 14:02:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMKPzAfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:34 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c8c3b7-17e2-4fb5-a9f5-6b390ede4b20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:02:34 user nova-compute[75453]: No targets found.
Nov 28 14:02:34 user nova-compute[75453]: iSNS:
Nov 28 14:02:34 user nova-compute[75453]: No targets found.
Nov 28 14:02:34 user nova-compute[75453]: STATIC:
Nov 28 14:02:34 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:02:34 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:34 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:34 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:02:34 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:34 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:34 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca
Nov 28 14:02:34 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:34 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:34 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59
Nov 28 14:02:34 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:34 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:34 user nova-compute[75453]: FIRMWARE:
Nov 28 14:02:34 user nova-compute[75453]: No targets found.
Nov 28 14:02:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:02:34 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:02:34 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c262ae-b6ee-4450-a473-2d1f685e0162]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c9a556-79f6-4590-a274-37fdebcf08a2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:02:34 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:34 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:34 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:02:34 user nova-compute[75453]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:34 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:34 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f024c2a2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bb68c7-3f27-432e-be6e-85bb9dfd16ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b4a3b3-13f9-43b9-8592-942a6cbc629a]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c44b6bd-0bcf-450b-a466-3b1f56273fd9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:02:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.085s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[988021d4-cbfb-43fa-91f3-28627839290e]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7df81f4e', '/dev/disk/by-id/scsi-1SCST_BIO7df81f4e-0043e28181ca504f', '/dev/disk/by-id/scsi-23030343365323831') {{(pid=86546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4dc785-eb0c-4f03-9644-910639459376]: (4, None) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a00d82-8159-4f94-816f-a9acd6ab5fb9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2dda6-d46e-49dc-a487-c2b87a28effe]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260]
Nov 28 14:02:35 user nova-compute[75453]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260] successful.
Nov 28 14:02:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d198796-457c-457f-9d1f-a3f650c48a51]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] <== disconnect_volume: return (454ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:02:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Deleting instance files /opt/stack/data/nova/instances/6466bc94-8a78-4541-a864-9f0370b212c1_del
Nov 28 14:02:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Deletion of /opt/stack/data/nova/instances/6466bc94-8a78-4541-a864-9f0370b212c1_del complete
Nov 28 14:02:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 6466bc94-8a78-4541-a864-9f0370b212c1 could not be found.
Nov 28 14:02:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMKPzAfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:35 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cb4a14-2261-4ef7-b518-8e159a5c12fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:02:35 user nova-compute[75453]: No targets found.
Nov 28 14:02:35 user nova-compute[75453]: iSNS:
Nov 28 14:02:35 user nova-compute[75453]: No targets found.
Nov 28 14:02:35 user nova-compute[75453]: STATIC:
Nov 28 14:02:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:02:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca
Nov 28 14:02:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:35 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59
Nov 28 14:02:35 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:35 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:35 user nova-compute[75453]: FIRMWARE:
Nov 28 14:02:35 user nova-compute[75453]: No targets found.
Nov 28 14:02:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:02:35 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:02:35 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a77a49-6645-4438-af99-de96d0e33622]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[83425562-66a8-4ae8-acdb-d5d55fa0b70e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:35 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:35 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:35 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:35 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:35 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0218710b80>, {}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Disconnecting from: [] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.102s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] <== disconnect_volume: return (104ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] No waiting events found dispatching network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:36 user nova-compute[75453]: WARNING nova.compute.manager [req-5542b98e-7365-4bc2-89dd-03b107699cde req-3e3274d2-3b01-400e-a20f-a520b2b70fdd service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received unexpected event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance with vm_state active and task_state rebuilding.
Nov 28 14:02:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:36 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Preparing to wait for external event volume-reimaged-0bbc90b3-d676-465d-8b27-6af2a82d5055 {{(pid=75453) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 28 14:02:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftPdySXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:38 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:02:38 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:02:38 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9193792c-4aa1-4c13-8222-e43c322869fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:02:38 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6933fcf-7d2b-4fb2-b920-002288ddcd39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa] added
Nov 28 14:02:38 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc6806-5b7c-4921-b371-e89b18d1de11]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b8884c-ad5f-449a-a865-ae2ab25468f9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftPdySXF {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftPdySXF" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[74846e91-9894-408c-bcf5-5ee90afca24a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ftPdySXF'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[897fce65-b220-4c18-bd30-395b687b7819]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d7b4e1-58b5-4f44-adbc-deaf8ef5b2d4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:38 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:38 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[64beeabc-868e-46cb-80cd-50c8d0e38599]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260]
Nov 28 14:02:38 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260] successful.
Nov 28 14:02:38 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b82a9f6-9a52-437a-b7fd-98fee6f16a4f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabf935a-27bd-49d8-a364-ed8a66907fb9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:02:38 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:38 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:02:38 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa57f352-72d2-47ad-ae28-122cc0b12b20]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:38 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvgESNbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:39 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftPdySXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23366333637623931', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366333637623931', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.603s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:02:39 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:02:39 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG nova.objects.instance [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'flavor' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c08d4-f2cf-4614-9e5f-bdea281f1e3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:02:39 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e75d6-00b9-4dd1-95cc-36e6992101ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee] added
Nov 28 14:02:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:02:39 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:02:39 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:02:39 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:02:39 user nova-compute[75453]:   <serial>cb097930-0134-453a-bf8a-a77dbeabc8fa</serial>
Nov 28 14:02:39 user nova-compute[75453]: </disk>
Nov 28 14:02:39 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2b26e2-1edd-4b3a-9f03-fa4c4a8ca37b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a442403a-fb13-4889-9a88-deac1bb76368]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvgESNbi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvgESNbi" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8546bc-9c90-4475-b25a-e272fbb4e31d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YvgESNbi'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[23577957-b4e5-48d2-926f-d43f669f8b4d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0381e7-5b23-4e47-b6d2-1ec56de0b096]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:02:40 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:02:40 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9c12cf-9a25-4aec-b55a-0fe04d4f7805]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee, portal: 172.16.0.220,3260]
Nov 28 14:02:40 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee, portal: 172.16.0.220,3260] successful.
Nov 28 14:02:40 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f9db7d-073c-45b1-ac8f-fad28a091f6e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a3cfd7-aa28-4c76-9f36-2a7355fd0d6a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:02:40 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:02:40 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:02:40 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[95377b7b-eea3-4410-9bc9-a06306785409]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvgESNbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] No VIF found with MAC fa:16:3e:a1:ed:0c, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:02:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5dc6353e-0b69-4f5f-8541-51e9c5ee3eb2 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.693s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:02:41 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] <== connect_volume: return (2004ms) {'type': 'block', 'scsi_wwn': '23936396666613836', 'path': '/dev/sdf'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:41 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936396666613836', 'path': '/dev/sdf'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:02:41 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'flavor' on Instance uuid e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:41 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:02:41 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:02:41 user nova-compute[75453]:   <source dev="/dev/sdf"/>
Nov 28 14:02:41 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:02:41 user nova-compute[75453]:   <serial>ee665431-8646-4683-a0e1-c392d691e7ee</serial>
Nov 28 14:02:41 user nova-compute[75453]: </disk>
Nov 28 14:02:41 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:02:41 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:41 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:41 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] No VIF found with MAC fa:16:3e:d5:9d:a1, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:02:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f93a019b-8cc5-49cf-adc3-9ff87b762373 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.191s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing instance network info cache due to event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:02:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] Acquiring lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] Acquired lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:47 user nova-compute[75453]: DEBUG nova.network.neutron [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:02:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:48 user nova-compute[75453]: DEBUG nova.network.neutron [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updated VIF entry in instance network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:02:48 user nova-compute[75453]: DEBUG nova.network.neutron [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating instance_info_cache with network_info: [{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7ed0d2e9-3fd8-48ff-a3cc-1ec5cfe692f0 req-a60d00a9-4f01-4577-9d09-cf530114eda2 service nova] Releasing lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:49 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d is timed out.
Nov 28 14:02:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Successfully detached device sdc from instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d from the live domain config.
Nov 28 14:02:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsQFOlmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:49 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465debc-fdd4-4b80-b058-715ac112240e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:02:49 user nova-compute[75453]: No targets found.
Nov 28 14:02:49 user nova-compute[75453]: iSNS:
Nov 28 14:02:49 user nova-compute[75453]: No targets found.
Nov 28 14:02:49 user nova-compute[75453]: STATIC:
Nov 28 14:02:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:02:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:02:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca
Nov 28 14:02:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:02:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59
Nov 28 14:02:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:49 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee
Nov 28 14:02:49 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:02:49 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:02:49 user nova-compute[75453]: FIRMWARE:
Nov 28 14:02:49 user nova-compute[75453]: No targets found.
Nov 28 14:02:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:02:49 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:02:49 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eff1b42-8491-42a2-a59d-746f35103796]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[555b2979-fa32-4119-989f-414a36bd6560]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:02:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:02:49 user nova-compute[75453]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:02:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f021878e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca'): ({'sde'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Removing single pathed devices sde {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4d201d-bf8e-4fb7-839d-462c4774c08f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c05cdd-6ca5-4f72-b581-03f55d097642]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Flushing IO for device /dev/sde {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ece3509-a019-44e3-9e99-140bb2c71786]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3770ed5-4e9d-4304-b200-ba9731a04734]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e52d466-99ba-4cd7-8e04-b4bf68b87a49]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c33d0a-d2c7-4141-b1ed-e4cd809a1fe4]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca, portal: 172.16.0.220,3260]
Nov 28 14:02:49 user nova-compute[75453]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca, portal: 172.16.0.220,3260] successful.
Nov 28 14:02:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfd2051-f1a1-44d0-967f-cfab350bd0ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[210f214c-b991-426c-9f4c-1bbd4cdfd0b7]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] <== disconnect_volume: return (369ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:02:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:50 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffdd71ab-3cbc-4f26-b028-86896e792d63 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.143s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing instance network info cache due to event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:02:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] Acquiring lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] Acquired lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:02:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updated VIF entry in instance network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:02:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating instance_info_cache with network_info: [{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-51ca560d-4dd2-4447-ae84-7d1d0bf3f415 req-e83a4a75-28a4-47d2-bebe-8eba07f6c81b service nova] Releasing lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:52 user nova-compute[75453]: INFO nova.compute.manager [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Terminating instance
Nov 28 14:02:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Instance destroyed successfully.
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.objects.instance [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lazy-loading 'resources' on Instance uuid 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T14:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1717889095',display_name='tempest-AttachSCSIVolumeTestJSON-server-1717889095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1717889095',id=15,image_ref='4c805d98-1957-42b5-99d6-f6b4807c6557',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLdh5KkZs2uRczkjfWNP8lhnjvPNkrz2kWYuh21IhX5LJ6HVeqLmAMoelvP7qtY4O1o8zNE86kmj07w3j5Qds7nQiYacJk1xc9F2fBooepoKUgkZbjcARaG+b/u9MMGIw==',key_name='tempest-keypair-601378316',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24b30ed6146c4a7f82b357d83df9e88b',ramdisk_id='',reservation_id='r-sqhh50yh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4c805d98-1957-42b5-99d6-f6b4807c6557',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-618513649',owner_user_name='tempest-AttachSCSIVolumeTestJSON-618513649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bda47eaf5e34007aacf101594a9a158',uuid=1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Converting VIF {"id": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "address": "fa:16:3e:de:ec:0f", "network": {"id": "5e9f6cb3-94c3-4518-9eba-ec555278d020", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230895615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24b30ed6146c4a7f82b357d83df9e88b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0cece8e-db", "ovs_interfaceid": "e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5,network=Network(5e9f6cb3-94c3-4518-9eba-ec555278d020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0cece8e-db') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG os_vif [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5,network=Network(5e9f6cb3-94c3-4518-9eba-ec555278d020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0cece8e-db') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0cece8e-db, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f9108a9-aed1-496a-b6b8-877a452fd454) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "b531830d-1e76-4b07-bed1-2b009e235382" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "b531830d-1e76-4b07-bed1-2b009e235382" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:53 user nova-compute[75453]: INFO os_vif [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:ec:0f,bridge_name='br-int',has_traffic_filtering=True,id=e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5,network=Network(5e9f6cb3-94c3-4518-9eba-ec555278d020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0cece8e-db')
Nov 28 14:02:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Deleting instance files /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d_del
Nov 28 14:02:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Deletion of /opt/stack/data/nova/instances/1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d_del complete
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received event network-vif-unplugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] No waiting events found dispatching network-vif-unplugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received event network-vif-unplugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received event network-vif-plugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Acquiring lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] No waiting events found dispatching network-vif-plugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:53 user nova-compute[75453]: WARNING nova.compute.manager [req-497a957a-4b4a-4089-956c-6eae501beed5 req-1c4d76be-c2c9-49ee-9b96-927524c13945 service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received unexpected event network-vif-plugged-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 for instance with vm_state active and task_state deleting.
Nov 28 14:02:53 user nova-compute[75453]: INFO nova.compute.manager [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:02:53 user nova-compute[75453]: INFO nova.compute.claims [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Claim successful on node user
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:02:53 user nova-compute[75453]: DEBUG nova.network.neutron [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:02:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:02:54 user nova-compute[75453]: DEBUG nova.policy [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:54 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Took 0.97 seconds to deallocate network for instance.
Nov 28 14:02:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:02:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Creating image(s)
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "/opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "/opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "/opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.205s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.204s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk 1073741824" returned: 0 in 0.110s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:54 user nova-compute[75453]: DEBUG nova.network.neutron [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Successfully created port: f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:02:54 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Deleted allocations for instance 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8215f1b0-a954-40ee-b0c6-4feaa3e59915 tempest-AttachSCSIVolumeTestJSON-618513649 tempest-AttachSCSIVolumeTestJSON-618513649-project-member] Lock "1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.853s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Cannot resize image /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Ensure instance console log exists: /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-9cacf4fd-fa1b-4c2f-929e-acdd06c97778 req-d1eab667-2b73-452f-ab81-c0b1369a41cd service nova] [instance: 1ddcea10-f7bc-4b70-bee1-b0e9c224ed5d] Received event network-vif-deleted-e0cece8e-db7e-4b2a-be66-cd0d81e8c5b5 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Successfully updated port: f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received event network-changed-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Refreshing instance network info cache due to event network-changed-f0bdc249-748c-4d50-82ce-ad985120d91f. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] Acquiring lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] Acquired lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.network.neutron [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Refreshing network info cache for port f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.network.neutron [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:55 user nova-compute[75453]: DEBUG nova.network.neutron [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0c938fa9-885e-4ee3-88be-c92ba682470f req-470302f2-cd38-4c13-b84e-b30b912176be service nova] Releasing lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquired lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.network.neutron [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.network.neutron [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.network.neutron [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updating instance_info_cache with network_info: [{"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Releasing lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Instance network_info: |[{"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Start _get_guest_xml network_info=[{"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:02:56 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:02:56 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-374540379',display_name='tempest-ServerActionsTestOtherA-server-374540379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-374540379',id=22,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g==',key_name='tempest-keypair-1318751346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-jwd7amzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=b531830d-1e76-4b07-bed1-2b009e235382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:07:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0bdc249-748c-4d50-82ce-ad985120d91f,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdc249-74') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.objects.instance [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'pci_devices' on Instance uuid b531830d-1e76-4b07-bed1-2b009e235382 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:02:56 user nova-compute[75453]:   <uuid>b531830d-1e76-4b07-bed1-2b009e235382</uuid>
Nov 28 14:02:56 user nova-compute[75453]:   <name>instance-00000016</name>
Nov 28 14:02:56 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:02:56 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:02:56 user nova-compute[75453]:   <metadata>
Nov 28 14:02:56 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:02:56 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:02:56 user nova-compute[75453]:       <nova:name>tempest-ServerActionsTestOtherA-server-374540379</nova:name>
Nov 28 14:02:56 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:02:56</nova:creationTime>
Nov 28 14:02:56 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:02:56 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:02:56 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:02:56 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:02:56 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:02:56 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:02:56 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:02:56 user nova-compute[75453]:       <nova:owner>
Nov 28 14:02:56 user nova-compute[75453]:         <nova:user uuid="9f84ee8a311d4619b7d51c2066d4775f">tempest-ServerActionsTestOtherA-1445772683-project-member</nova:user>
Nov 28 14:02:56 user nova-compute[75453]:         <nova:project uuid="82ab030af40f43e28b5f1b7ce64c50a8">tempest-ServerActionsTestOtherA-1445772683</nova:project>
Nov 28 14:02:56 user nova-compute[75453]:       </nova:owner>
Nov 28 14:02:56 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:02:56 user nova-compute[75453]:       <nova:ports>
Nov 28 14:02:56 user nova-compute[75453]:         <nova:port uuid="f0bdc249-748c-4d50-82ce-ad985120d91f">
Nov 28 14:02:56 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 14:02:56 user nova-compute[75453]:         </nova:port>
Nov 28 14:02:56 user nova-compute[75453]:       </nova:ports>
Nov 28 14:02:56 user nova-compute[75453]:     </nova:instance>
Nov 28 14:02:56 user nova-compute[75453]:   </metadata>
Nov 28 14:02:56 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:02:56 user nova-compute[75453]:     <system>
Nov 28 14:02:56 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:02:56 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:02:56 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:02:56 user nova-compute[75453]:       <entry name="serial">b531830d-1e76-4b07-bed1-2b009e235382</entry>
Nov 28 14:02:56 user nova-compute[75453]:       <entry name="uuid">b531830d-1e76-4b07-bed1-2b009e235382</entry>
Nov 28 14:02:56 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:02:56 user nova-compute[75453]:     </system>
Nov 28 14:02:56 user nova-compute[75453]:   </sysinfo>
Nov 28 14:02:56 user nova-compute[75453]:   <os>
Nov 28 14:02:56 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:02:56 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:02:56 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:02:56 user nova-compute[75453]:   </os>
Nov 28 14:02:56 user nova-compute[75453]:   <features>
Nov 28 14:02:56 user nova-compute[75453]:     <acpi/>
Nov 28 14:02:56 user nova-compute[75453]:     <apic/>
Nov 28 14:02:56 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:02:56 user nova-compute[75453]:   </features>
Nov 28 14:02:56 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:02:56 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:02:56 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:02:56 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:02:56 user nova-compute[75453]:   </clock>
Nov 28 14:02:56 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:02:56 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:02:56 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:02:56 user nova-compute[75453]:   </cpu>
Nov 28 14:02:56 user nova-compute[75453]:   <devices>
Nov 28 14:02:56 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:02:56 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:02:56 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk"/>
Nov 28 14:02:56 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:02:56 user nova-compute[75453]:     </disk>
Nov 28 14:02:56 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:02:56 user nova-compute[75453]:       <mac address="fa:16:3e:4b:07:bc"/>
Nov 28 14:02:56 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:02:56 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:02:56 user nova-compute[75453]:       <target dev="tapf0bdc249-74"/>
Nov 28 14:02:56 user nova-compute[75453]:     </interface>
Nov 28 14:02:56 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:02:56 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/console.log" append="off"/>
Nov 28 14:02:56 user nova-compute[75453]:     </serial>
Nov 28 14:02:56 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:02:56 user nova-compute[75453]:     <video>
Nov 28 14:02:56 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:02:56 user nova-compute[75453]:     </video>
Nov 28 14:02:56 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:02:56 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:02:56 user nova-compute[75453]:     </rng>
Nov 28 14:02:56 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:02:56 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:02:56 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:02:56 user nova-compute[75453]:     </memballoon>
Nov 28 14:02:56 user nova-compute[75453]:   </devices>
Nov 28 14:02:56 user nova-compute[75453]: </domain>
Nov 28 14:02:56 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-374540379',display_name='tempest-ServerActionsTestOtherA-server-374540379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-374540379',id=22,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g==',key_name='tempest-keypair-1318751346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-jwd7amzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=b531830d-1e76-4b07-bed1-2b009e235382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:07:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0bdc249-748c-4d50-82ce-ad985120d91f,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdc249-74') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG os_vif [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:07:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0bdc249-748c-4d50-82ce-ad985120d91f,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdc249-74') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90ce761d-cd78-5196-a8f6-4daca614f139', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0bdc249-74, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0bdc249-74, col_values=(('qos', UUID('d045ad82-e475-4f14-b6cd-54900dc35214')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0bdc249-74, col_values=(('external_ids', {'iface-id': 'f0bdc249-748c-4d50-82ce-ad985120d91f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:07:bc', 'vm-uuid': 'b531830d-1e76-4b07-bed1-2b009e235382'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:56 user nova-compute[75453]: INFO os_vif [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:07:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0bdc249-748c-4d50-82ce-ad985120d91f,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdc249-74')
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:02:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No VIF found with MAC fa:16:3e:4b:07:bc, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event volume-reimaged-0bbc90b3-d676-465d-8b27-6af2a82d5055 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 req-a3f75ec1-3735-4d1c-a815-6c6a21921018 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Processing event volume-reimaged-0bbc90b3-d676-465d-8b27-6af2a82d5055 {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:02:57 user nova-compute[75453]: INFO nova.virt.block_device [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Booting with volume 0bbc90b3-d676-465d-8b27-6af2a82d5055 at /dev/vda
Nov 28 14:02:57 user nova-compute[75453]: DEBUG os_brick.utils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88bb829-9abb-40b4-88d5-bb77db1e35dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e86a5-8e4e-4471-9de2-feb9c529274e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a64b531-8cd0-426e-8e94-d711b6435b25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfda219-012f-4115-93d0-d8a4abba8582]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:02:57 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:02:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa01e962-1a1a-4b08-bd06-072f0cb9950e]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG os_brick.utils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Updating existing volume attachment record: 6d9c8c69-e336-4b2d-95d9-54dfd28b80db {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received event network-vif-plugged-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] Acquiring lock "b531830d-1e76-4b07-bed1-2b009e235382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] No waiting events found dispatching network-vif-plugged-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:58 user nova-compute[75453]: WARNING nova.compute.manager [req-e95724b1-1d11-46be-aeca-43bc1d3c9476 req-b9886e63-14ed-459c-a2c3-37e382cc861c service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received unexpected event network-vif-plugged-f0bdc249-748c-4d50-82ce-ad985120d91f for instance with vm_state building and task_state spawning.
Nov 28 14:02:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:58 user nova-compute[75453]: INFO nova.compute.manager [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Rebooting instance
Nov 28 14:02:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquired lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:02:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating instance_info_cache with network_info: [{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Releasing lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-unplugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:02:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] No waiting events found dispatching network-vif-unplugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:02:59 user nova-compute[75453]: WARNING nova.compute.manager [req-817271aa-a0ad-4857-bc9e-ab57c51a91db req-0683c62e-b94a-4ebc-b7e9-f54db3886025 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received unexpected event network-vif-unplugged-43357932-6c86-4dd1-9f8b-22adab7793b9 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received event network-vif-plugged-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] Acquiring lock "b531830d-1e76-4b07-bed1-2b009e235382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] No waiting events found dispatching network-vif-plugged-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:00 user nova-compute[75453]: WARNING nova.compute.manager [req-854779bb-9679-445c-828c-22425b656895 req-728ce77f-477a-434a-8983-7b2c5c980c22 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received unexpected event network-vif-plugged-f0bdc249-748c-4d50-82ce-ad985120d91f for instance with vm_state building and task_state spawning.
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:03:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Instance spawned successfully.
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:03:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Instance destroyed successfully.
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'resources' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1236309658',display_name='tempest-TestMinimumBasicScenario-server-1236309658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1236309658',id=16,image_ref='13624d8f-7316-4efc-8993-8da1904872d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYvCKgE/uykfhOgOg6D3nUJ6Umd15sNMuRUU7xu8xWn0qGR9/rUAbuCSIg8mpk+H8TVnl8JQxOpUjgQJBLfW2bLKjH0SnWK8Q02tRGF2ZPKxSiZhErFGWHG+pBmFqIquw==',key_name='tempest-TestMinimumBasicScenario-423384039',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:00:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4056ca714ed4e85878d7819ef63b20c',ramdisk_id='',reservation_id='r-stm222as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13624d8f-7316-4efc-8993-8da1904872d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2080131890',owner_user_name='tempest-TestMinimumBasicScenario-2080131890-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:02:59Z,user_data=None,user_id='e109047aa8a34d8aad03c6c0dc14c7c8',uuid=ea32aeb2-975a-4295-aeb6-12e177657219,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converting VIF {"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_vif [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43357932-6c, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1619616-7ec9-47d8-a4e2-0acdd0a24a9a) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:00 user nova-compute[75453]: INFO os_vif [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c')
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftPdySXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:03:00 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b045c8d-ad39-4091-8a31-f7e9b0c79981]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:03:00 user nova-compute[75453]: No targets found.
Nov 28 14:03:00 user nova-compute[75453]: iSNS:
Nov 28 14:03:00 user nova-compute[75453]: No targets found.
Nov 28 14:03:00 user nova-compute[75453]: STATIC:
Nov 28 14:03:00 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:03:00 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:00 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:00 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:03:00 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:00 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:00 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59
Nov 28 14:03:00 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:00 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:00 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee
Nov 28 14:03:00 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:00 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:00 user nova-compute[75453]: FIRMWARE:
Nov 28 14:03:00 user nova-compute[75453]: No targets found.
Nov 28 14:03:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:03:00 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:03:00 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: INFO nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b4534-e4a7-4dbb-8888-14d49548faf4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17d6c3-0f5d-4608-a8eb-15ad362319fd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02187aecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.064s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e57d8-bde2-4840-83cb-4230266217c9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0053b1fe-696b-4dc5-97e6-c19e5acf1bf5]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c525e57-22fc-47c6-a7f2-5f1c861ea44f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:03:00 user nova-compute[75453]: INFO nova.compute.manager [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Took 7.25 seconds to build instance.
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-48776eef-bd02-4690-86ac-49595be890fe tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "b531830d-1e76-4b07-bed1-2b009e235382" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.367s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0a8cb6-41cc-4649-9ac0-0c85177c3529]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cca8dc7-21b9-4c1f-ae9d-cac43fba6d2b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[37423aa9-78db-4f36-88a9-3f56f0ada077]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260]
Nov 28 14:03:00 user nova-compute[75453]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260] successful.
Nov 28 14:03:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cba9ddd-b610-4b9b-b91e-63ad0ee0bbbb]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] <== disconnect_volume: return (385ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Start _get_guest_xml network_info=[{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=13624d8f-7316-4efc-8993-8da1904872d5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '13624d8f-7316-4efc-8993-8da1904872d5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '67de0bc0-cdb4-460f-9e30-4ad83ac12071', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftPdySXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ea32aeb2-975a-4295-aeb6-12e177657219', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb097930-0134-453a-bf8a-a77dbeabc8fa', 'serial': 'cb097930-0134-453a-bf8a-a77dbeabc8fa'}, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:03:00 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:03:00 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=13624d8f-7316-4efc-8993-8da1904872d5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.objects.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Object Instance<ea32aeb2-975a-4295-aeb6-12e177657219> lazy-loaded attributes: resources,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftPdySXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:03:00 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:03:00 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:03:00 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[21300088-ba7b-46c0-8862-524ff1f54a21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:03:00 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e18efd-2c16-4f8f-8683-b0fe337b9af4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa] added
Nov 28 14:03:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5714bf-d295-419e-a45b-0323db72098a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8fe5ac-7179-412f-84c9-bfdc0e2faa75]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftPdySXF {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftPdySXF" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[52828668-fd67-4a5a-9e99-a020417158d9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ftPdySXF'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[01315b59-7c19-4592-bf9c-0737cda3d80b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa26bde-033d-44d9-bd7d-fef8e9f3dbe3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:00 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:03:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f908135d-0e6a-4685-9c16-317d16682382]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260]
Nov 28 14:03:01 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260] successful.
Nov 28 14:03:01 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db2d5ee-e5b5-406c-9c11-e9df06b74d27]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6863702-046a-4c9f-8e68-4c36a457e8d5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:01 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:01 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:01 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:01 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:01 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:01 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:01 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:01 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c2f98-f410-4c58-a9eb-f88adcd82acc]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] No waiting events found dispatching network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:01 user nova-compute[75453]: WARNING nova.compute.manager [req-25217d3f-4761-4066-aaf8-cbe80237f381 req-c4ea1090-9d67-4c0c-990d-193bc4efadca service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received unexpected event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:01 user nova-compute[75453]: INFO nova.compute.manager [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Detaching volume ee665431-8646-4683-a0e1-c392d691e7ee
Nov 28 14:03:01 user nova-compute[75453]: INFO nova.virt.block_device [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Attempting to driver detach volume ee665431-8646-4683-a0e1-c392d691e7ee from mountpoint /dev/vdb
Nov 28 14:03:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Attempting to detach device vdb from instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:03:01 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:03:01 user nova-compute[75453]:   <source dev="/dev/sdf"/>
Nov 28 14:03:01 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:03:01 user nova-compute[75453]:   <serial>ee665431-8646-4683-a0e1-c392d691e7ee</serial>
Nov 28 14:03:01 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:03:01 user nova-compute[75453]: </disk>
Nov 28 14:03:01 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:03:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Successfully detached device vdb from instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 from the persistent domain config.
Nov 28 14:03:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:03:01 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:03:01 user nova-compute[75453]:   <source dev="/dev/sdf"/>
Nov 28 14:03:01 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:03:01 user nova-compute[75453]:   <serial>ee665431-8646-4683-a0e1-c392d691e7ee</serial>
Nov 28 14:03:01 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:03:01 user nova-compute[75453]: </disk>
Nov 28 14:03:01 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftPdySXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23366333637623931', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366333637623931', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1236309658',display_name='tempest-TestMinimumBasicScenario-server-1236309658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1236309658',id=16,image_ref='13624d8f-7316-4efc-8993-8da1904872d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYvCKgE/uykfhOgOg6D3nUJ6Umd15sNMuRUU7xu8xWn0qGR9/rUAbuCSIg8mpk+H8TVnl8JQxOpUjgQJBLfW2bLKjH0SnWK8Q02tRGF2ZPKxSiZhErFGWHG+pBmFqIquw==',key_name='tempest-TestMinimumBasicScenario-423384039',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:00:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4056ca714ed4e85878d7819ef63b20c',ramdisk_id='',reservation_id='r-stm222as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13624d8f-7316-4efc-8993-8da1904872d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2080131890',owner_user_name='tempest-TestMinimumBasicScenario-2080131890-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:02:59Z,user_data=None,user_id='e109047aa8a34d8aad03c6c0dc14c7c8',uuid=ea32aeb2-975a-4295-aeb6-12e177657219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converting VIF {"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'pci_devices' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.objects.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Object Instance<ea32aeb2-975a-4295-aeb6-12e177657219> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:03:02 user nova-compute[75453]:   <uuid>ea32aeb2-975a-4295-aeb6-12e177657219</uuid>
Nov 28 14:03:02 user nova-compute[75453]:   <name>instance-00000010</name>
Nov 28 14:03:02 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:03:02 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:03:02 user nova-compute[75453]:   <metadata>
Nov 28 14:03:02 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:03:02 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:03:02 user nova-compute[75453]:       <nova:name>tempest-TestMinimumBasicScenario-server-1236309658</nova:name>
Nov 28 14:03:02 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:03:00</nova:creationTime>
Nov 28 14:03:02 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:03:02 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:03:02 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:03:02 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:03:02 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:03:02 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:03:02 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:03:02 user nova-compute[75453]:       <nova:owner>
Nov 28 14:03:02 user nova-compute[75453]:         <nova:user uuid="e109047aa8a34d8aad03c6c0dc14c7c8">tempest-TestMinimumBasicScenario-2080131890-project-member</nova:user>
Nov 28 14:03:02 user nova-compute[75453]:         <nova:project uuid="f4056ca714ed4e85878d7819ef63b20c">tempest-TestMinimumBasicScenario-2080131890</nova:project>
Nov 28 14:03:02 user nova-compute[75453]:       </nova:owner>
Nov 28 14:03:02 user nova-compute[75453]:       <nova:root type="image" uuid="13624d8f-7316-4efc-8993-8da1904872d5"/>
Nov 28 14:03:02 user nova-compute[75453]:       <nova:ports>
Nov 28 14:03:02 user nova-compute[75453]:         <nova:port uuid="43357932-6c86-4dd1-9f8b-22adab7793b9">
Nov 28 14:03:02 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 14:03:02 user nova-compute[75453]:         </nova:port>
Nov 28 14:03:02 user nova-compute[75453]:       </nova:ports>
Nov 28 14:03:02 user nova-compute[75453]:     </nova:instance>
Nov 28 14:03:02 user nova-compute[75453]:   </metadata>
Nov 28 14:03:02 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:03:02 user nova-compute[75453]:     <system>
Nov 28 14:03:02 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:03:02 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:03:02 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:03:02 user nova-compute[75453]:       <entry name="serial">ea32aeb2-975a-4295-aeb6-12e177657219</entry>
Nov 28 14:03:02 user nova-compute[75453]:       <entry name="uuid">ea32aeb2-975a-4295-aeb6-12e177657219</entry>
Nov 28 14:03:02 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:03:02 user nova-compute[75453]:     </system>
Nov 28 14:03:02 user nova-compute[75453]:   </sysinfo>
Nov 28 14:03:02 user nova-compute[75453]:   <os>
Nov 28 14:03:02 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:03:02 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:03:02 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:03:02 user nova-compute[75453]:   </os>
Nov 28 14:03:02 user nova-compute[75453]:   <features>
Nov 28 14:03:02 user nova-compute[75453]:     <acpi/>
Nov 28 14:03:02 user nova-compute[75453]:     <apic/>
Nov 28 14:03:02 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:03:02 user nova-compute[75453]:   </features>
Nov 28 14:03:02 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:03:02 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:03:02 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:03:02 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:03:02 user nova-compute[75453]:   </clock>
Nov 28 14:03:02 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:03:02 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:03:02 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:03:02 user nova-compute[75453]:   </cpu>
Nov 28 14:03:02 user nova-compute[75453]:   <devices>
Nov 28 14:03:02 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:03:02 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:03:02 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk"/>
Nov 28 14:03:02 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:03:02 user nova-compute[75453]:     </disk>
Nov 28 14:03:02 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:03:02 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:03:02 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:03:02 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 14:03:02 user nova-compute[75453]:       <serial>cb097930-0134-453a-bf8a-a77dbeabc8fa</serial>
Nov 28 14:03:02 user nova-compute[75453]:     </disk>
Nov 28 14:03:02 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:03:02 user nova-compute[75453]:       <mac address="fa:16:3e:a1:ed:0c"/>
Nov 28 14:03:02 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:03:02 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:03:02 user nova-compute[75453]:       <target dev="tap43357932-6c"/>
Nov 28 14:03:02 user nova-compute[75453]:     </interface>
Nov 28 14:03:02 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:03:02 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/console.log" append="off"/>
Nov 28 14:03:02 user nova-compute[75453]:     </serial>
Nov 28 14:03:02 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:03:02 user nova-compute[75453]:     <video>
Nov 28 14:03:02 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:03:02 user nova-compute[75453]:     </video>
Nov 28 14:03:02 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:03:02 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:03:02 user nova-compute[75453]:     </rng>
Nov 28 14:03:02 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:03:02 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:03:02 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:03:02 user nova-compute[75453]:     </memballoon>
Nov 28 14:03:02 user nova-compute[75453]:   </devices>
Nov 28 14:03:02 user nova-compute[75453]: </domain>
Nov 28 14:03:02 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.objects.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Object Instance<ea32aeb2-975a-4295-aeb6-12e177657219> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71 --force-share --output=json" returned: 0 in 0.208s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Cannot resize image /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'migration_context' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG nova.objects.base [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Object Instance<ea32aeb2-975a-4295-aeb6-12e177657219> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1236309658',display_name='tempest-TestMinimumBasicScenario-server-1236309658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1236309658',id=16,image_ref='13624d8f-7316-4efc-8993-8da1904872d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYvCKgE/uykfhOgOg6D3nUJ6Umd15sNMuRUU7xu8xWn0qGR9/rUAbuCSIg8mpk+H8TVnl8JQxOpUjgQJBLfW2bLKjH0SnWK8Q02tRGF2ZPKxSiZhErFGWHG+pBmFqIquw==',key_name='tempest-TestMinimumBasicScenario-423384039',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:00:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='f4056ca714ed4e85878d7819ef63b20c',ramdisk_id='',reservation_id='r-stm222as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13624d8f-7316-4efc-8993-8da1904872d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2080131890',owner_user_name='tempest-TestMinimumBasicScenario-2080131890-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:59Z,user_data=None,user_id='e109047aa8a34d8aad03c6c0dc14c7c8',uuid=ea32aeb2-975a-4295-aeb6-12e177657219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converting VIF {"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG os_vif [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05bd0d90-5ce7-5189-882f-705acdfbda52', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43357932-6c, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43357932-6c, col_values=(('qos', UUID('03603bbb-2c45-4d33-b222-2f6b0ec0422a')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43357932-6c, col_values=(('external_ids', {'iface-id': '43357932-6c86-4dd1-9f8b-22adab7793b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:ed:0c', 'vm-uuid': 'ea32aeb2-975a-4295-aeb6-12e177657219'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:03 user nova-compute[75453]: INFO os_vif [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c')
Nov 28 14:03:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] No waiting events found dispatching network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:04 user nova-compute[75453]: WARNING nova.compute.manager [req-86e2fa4b-a9dd-444d-aa45-f7d5ddaae773 req-5bb09150-c1a6-4d36-8d6b-4d932de69b0b service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received unexpected event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 14:03:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:03:05 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Creating image(s)
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Ensure instance console log exists: /opt/stack/data/nova/instances/6466bc94-8a78-4541-a864-9f0370b212c1/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Start _get_guest_xml network_info=[{"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6d9c8c69-e336-4b2d-95d9-54dfd28b80db', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMKPzAfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6466bc94-8a78-4541-a864-9f0370b212c1', 'attached_at': '', 'detached_at': '', 'volume_id': '0bbc90b3-d676-465d-8b27-6af2a82d5055', 'serial': '0bbc90b3-d676-465d-8b27-6af2a82d5055'}, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:03:05 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 14:03:05 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.objects.instance [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6466bc94-8a78-4541-a864-9f0370b212c1 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMKPzAfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:03:05 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:03:05 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:03:05 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9c321-2abe-4fe8-9dd3-b126092f515c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:03:05 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[90548a7c-3204-4936-9eb6-fc061a26ec26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055] added
Nov 28 14:03:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6d2a07-29e9-4abf-91fa-2dd2d77166ba]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c5dc0e-58e7-4793-bf47-4f32db1b2b7c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMKPzAfh {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMKPzAfh" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b25718f-fbe8-4d54-ade5-378b1e5f566b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uMKPzAfh'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ec429a-35d8-4629-a291-ce3d5ee52bc4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdd6767-97be-45f4-bdb0-4c0587d9a0d0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:05 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:05 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:05 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:05 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:05 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:05 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dfc342-b3de-4916-8ef6-8ace9a4074e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260]
Nov 28 14:03:06 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260] successful.
Nov 28 14:03:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07d92c5-320f-460b-aaf4-95cffa532bb3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88716f8-699d-4fa1-b47b-9cfaae8b56eb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:06 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:06 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:06 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:06 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:06 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:06 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:06 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:06 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae80aae0-da87-4c9a-a239-d78197dbd934]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:03:06 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Instance rebooted successfully.
Nov 28 14:03:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] No waiting events found dispatching network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:06 user nova-compute[75453]: WARNING nova.compute.manager [req-4fc51ebd-14ed-42b0-9782-75d0f2092173 req-f9e6e473-5c39-42e5-8b02-3008a0b475b0 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received unexpected event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 14:03:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f6f86b72-dbb5-4898-adeb-eb051c8533b8 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.237s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMKPzAfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23030343365323831', 'path': '/dev/sde'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030343365323831', 'path': '/dev/sde'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1664826618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1576957829',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCE1KdXUl0gyKQN8cxHdQBSdoIOXAXck9gShrFsDuTComCOmZg1HXlk/E0PRpSF3JI/duBB0wGIY1DEhRduzsv/cvgYCVHRukYUjTiF6VZpcGAYot9rGCCTrNA5JY+6g==',key_name='tempest-keypair-1958037787',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cbf581e03a6c4f678536c9d64fe4b8cc',ramdisk_id='',reservation_id='r-le3gxts7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2097640131',owner_user_name='tempest-ServerActionsV293TestJSON-2097640131-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1406382a40d841b5a59d791ec6744fc4',uuid=6466bc94-8a78-4541-a864-9f0370b212c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converting VIF {"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:03:07 user nova-compute[75453]:   <uuid>6466bc94-8a78-4541-a864-9f0370b212c1</uuid>
Nov 28 14:03:07 user nova-compute[75453]:   <name>instance-00000012</name>
Nov 28 14:03:07 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:03:07 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:03:07 user nova-compute[75453]:   <metadata>
Nov 28 14:03:07 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:03:07 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:03:07 user nova-compute[75453]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1664826618</nova:name>
Nov 28 14:03:07 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:03:05</nova:creationTime>
Nov 28 14:03:07 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:03:07 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:03:07 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:03:07 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:03:07 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:03:07 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:03:07 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:03:07 user nova-compute[75453]:       <nova:owner>
Nov 28 14:03:07 user nova-compute[75453]:         <nova:user uuid="1406382a40d841b5a59d791ec6744fc4">tempest-ServerActionsV293TestJSON-2097640131-project-member</nova:user>
Nov 28 14:03:07 user nova-compute[75453]:         <nova:project uuid="cbf581e03a6c4f678536c9d64fe4b8cc">tempest-ServerActionsV293TestJSON-2097640131</nova:project>
Nov 28 14:03:07 user nova-compute[75453]:       </nova:owner>
Nov 28 14:03:07 user nova-compute[75453]:       <nova:ports>
Nov 28 14:03:07 user nova-compute[75453]:         <nova:port uuid="f85d8e95-0038-4312-bfc1-28b0a2354a09">
Nov 28 14:03:07 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:03:07 user nova-compute[75453]:         </nova:port>
Nov 28 14:03:07 user nova-compute[75453]:       </nova:ports>
Nov 28 14:03:07 user nova-compute[75453]:     </nova:instance>
Nov 28 14:03:07 user nova-compute[75453]:   </metadata>
Nov 28 14:03:07 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:03:07 user nova-compute[75453]:     <system>
Nov 28 14:03:07 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:03:07 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:03:07 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:03:07 user nova-compute[75453]:       <entry name="serial">6466bc94-8a78-4541-a864-9f0370b212c1</entry>
Nov 28 14:03:07 user nova-compute[75453]:       <entry name="uuid">6466bc94-8a78-4541-a864-9f0370b212c1</entry>
Nov 28 14:03:07 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:03:07 user nova-compute[75453]:     </system>
Nov 28 14:03:07 user nova-compute[75453]:   </sysinfo>
Nov 28 14:03:07 user nova-compute[75453]:   <os>
Nov 28 14:03:07 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:03:07 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:03:07 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:03:07 user nova-compute[75453]:   </os>
Nov 28 14:03:07 user nova-compute[75453]:   <features>
Nov 28 14:03:07 user nova-compute[75453]:     <acpi/>
Nov 28 14:03:07 user nova-compute[75453]:     <apic/>
Nov 28 14:03:07 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:03:07 user nova-compute[75453]:   </features>
Nov 28 14:03:07 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:03:07 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:03:07 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:03:07 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:03:07 user nova-compute[75453]:   </clock>
Nov 28 14:03:07 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:03:07 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:03:07 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:03:07 user nova-compute[75453]:   </cpu>
Nov 28 14:03:07 user nova-compute[75453]:   <devices>
Nov 28 14:03:07 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:03:07 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:03:07 user nova-compute[75453]:       <source dev="/dev/sde"/>
Nov 28 14:03:07 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:03:07 user nova-compute[75453]:       <serial>0bbc90b3-d676-465d-8b27-6af2a82d5055</serial>
Nov 28 14:03:07 user nova-compute[75453]:     </disk>
Nov 28 14:03:07 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:03:07 user nova-compute[75453]:       <mac address="fa:16:3e:c7:e0:b2"/>
Nov 28 14:03:07 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:03:07 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:03:07 user nova-compute[75453]:       <target dev="tapf85d8e95-00"/>
Nov 28 14:03:07 user nova-compute[75453]:     </interface>
Nov 28 14:03:07 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:03:07 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/6466bc94-8a78-4541-a864-9f0370b212c1/console.log" append="off"/>
Nov 28 14:03:07 user nova-compute[75453]:     </serial>
Nov 28 14:03:07 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:03:07 user nova-compute[75453]:     <video>
Nov 28 14:03:07 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:03:07 user nova-compute[75453]:     </video>
Nov 28 14:03:07 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:03:07 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:03:07 user nova-compute[75453]:     </rng>
Nov 28 14:03:07 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:03:07 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:03:07 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:03:07 user nova-compute[75453]:     </memballoon>
Nov 28 14:03:07 user nova-compute[75453]:   </devices>
Nov 28 14:03:07 user nova-compute[75453]: </domain>
Nov 28 14:03:07 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1664826618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1576957829',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCE1KdXUl0gyKQN8cxHdQBSdoIOXAXck9gShrFsDuTComCOmZg1HXlk/E0PRpSF3JI/duBB0wGIY1DEhRduzsv/cvgYCVHRukYUjTiF6VZpcGAYot9rGCCTrNA5JY+6g==',key_name='tempest-keypair-1958037787',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cbf581e03a6c4f678536c9d64fe4b8cc',ramdisk_id='',reservation_id='r-le3gxts7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2097640131',owner_user_name='tempest-ServerActionsV293TestJSON-2097640131-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1406382a40d841b5a59d791ec6744fc4',uuid=6466bc94-8a78-4541-a864-9f0370b212c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converting VIF {"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG os_vif [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22306c76-0120-5f7d-bb71-2e8eb2566d19', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf85d8e95-00, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf85d8e95-00, col_values=(('qos', UUID('d244e5cb-9f0d-4ac6-853f-0be237099e6a')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf85d8e95-00, col_values=(('external_ids', {'iface-id': 'f85d8e95-0038-4312-bfc1-28b0a2354a09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:e0:b2', 'vm-uuid': '6466bc94-8a78-4541-a864-9f0370b212c1'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:07 user nova-compute[75453]: INFO os_vif [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00')
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] No VIF found with MAC fa:16:3e:c7:e0:b2, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:03:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] No waiting events found dispatching network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:09 user nova-compute[75453]: WARNING nova.compute.manager [req-00a3b02e-ca22-4f80-9538-17eaa389a504 req-6ecbf509-d996-4a9a-aaeb-6f628fa762d3 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received unexpected event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 14:03:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:03:11 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance spawned successfully.
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] No waiting events found dispatching network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:11 user nova-compute[75453]: WARNING nova.compute.manager [req-72aaa54e-793b-44da-8d5a-60999b2699c2 req-63afccef-43d2-47a3-80bb-fd76b7ace5ef service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received unexpected event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG nova.objects.instance [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75453) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5fd58388-ce52-4c68-8dae-2f49f77d70f3 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.103s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:03:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:03:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:03:15 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:03:15 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7568MB free_disk=25.332077026367188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 48dd0221-4935-4ee2-9958-90a748fe5255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance ea32aeb2-975a-4295-aeb6-12e177657219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 6466bc94-8a78-4541-a864-9f0370b212c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 807c145e-9d41-4a76-8777-c033276ba96a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 3aa772d7-ca30-4a90-b326-3450f9e28784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:03:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Skipping network cache update for instance because it is being deleted. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:03:16 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 48dd0221-4935-4ee2-9958-90a748fe5255 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Updating instance_info_cache with network_info: [{"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-48dd0221-4935-4ee2-9958-90a748fe5255" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquired lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.network.neutron [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'info_cache' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.objects.base [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.network.neutron [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating instance_info_cache with network_info: [{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Releasing lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:03:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance destroyed successfully.
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'resources' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.objects.base [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1751161168',display_name='tempest-AttachVolumeTestJSON-server-1751161168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1751161168',id=2,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw==',key_name='tempest-keypair-605550184',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-hiprfdzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:01:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=10e135e2-a52b-437c-adb6-3fb81daf17e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG os_vif [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56d8de7f-0f, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bec1848-d3fc-4d57-b06b-3baceb2c4735) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:17 user nova-compute[75453]: INFO os_vif [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f')
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Start _get_guest_xml network_info=[{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'numa_topology' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.objects.base [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:03:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:17 user nova-compute[75453]: DEBUG nova.objects.base [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1751161168',display_name='tempest-AttachVolumeTestJSON-server-1751161168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1751161168',id=2,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw==',key_name='tempest-keypair-605550184',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-hiprfdzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:01:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=10e135e2-a52b-437c-adb6-3fb81daf17e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.objects.instance [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'pci_devices' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.objects.base [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:03:18 user nova-compute[75453]:   <uuid>10e135e2-a52b-437c-adb6-3fb81daf17e4</uuid>
Nov 28 14:03:18 user nova-compute[75453]:   <name>instance-00000002</name>
Nov 28 14:03:18 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:03:18 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:03:18 user nova-compute[75453]:   <metadata>
Nov 28 14:03:18 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:03:18 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:03:18 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeTestJSON-server-1751161168</nova:name>
Nov 28 14:03:18 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:03:17</nova:creationTime>
Nov 28 14:03:18 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:03:18 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:03:18 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:03:18 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:03:18 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:03:18 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:03:18 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:03:18 user nova-compute[75453]:       <nova:owner>
Nov 28 14:03:18 user nova-compute[75453]:         <nova:user uuid="c38a4b08cd204e2a9b313a7740df3f3e">tempest-AttachVolumeTestJSON-15045878-project-member</nova:user>
Nov 28 14:03:18 user nova-compute[75453]:         <nova:project uuid="56b5137584864cf094d60d14e6f0ab0f">tempest-AttachVolumeTestJSON-15045878</nova:project>
Nov 28 14:03:18 user nova-compute[75453]:       </nova:owner>
Nov 28 14:03:18 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:03:18 user nova-compute[75453]:       <nova:ports>
Nov 28 14:03:18 user nova-compute[75453]:         <nova:port uuid="56d8de7f-0f8a-4f2e-8890-405ec6cb9294">
Nov 28 14:03:18 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 14:03:18 user nova-compute[75453]:         </nova:port>
Nov 28 14:03:18 user nova-compute[75453]:       </nova:ports>
Nov 28 14:03:18 user nova-compute[75453]:     </nova:instance>
Nov 28 14:03:18 user nova-compute[75453]:   </metadata>
Nov 28 14:03:18 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:03:18 user nova-compute[75453]:     <system>
Nov 28 14:03:18 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:03:18 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:03:18 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:03:18 user nova-compute[75453]:       <entry name="serial">10e135e2-a52b-437c-adb6-3fb81daf17e4</entry>
Nov 28 14:03:18 user nova-compute[75453]:       <entry name="uuid">10e135e2-a52b-437c-adb6-3fb81daf17e4</entry>
Nov 28 14:03:18 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:03:18 user nova-compute[75453]:     </system>
Nov 28 14:03:18 user nova-compute[75453]:   </sysinfo>
Nov 28 14:03:18 user nova-compute[75453]:   <os>
Nov 28 14:03:18 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:03:18 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:03:18 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:03:18 user nova-compute[75453]:   </os>
Nov 28 14:03:18 user nova-compute[75453]:   <features>
Nov 28 14:03:18 user nova-compute[75453]:     <acpi/>
Nov 28 14:03:18 user nova-compute[75453]:     <apic/>
Nov 28 14:03:18 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:03:18 user nova-compute[75453]:   </features>
Nov 28 14:03:18 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:03:18 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:03:18 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:03:18 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:03:18 user nova-compute[75453]:   </clock>
Nov 28 14:03:18 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:03:18 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:03:18 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:03:18 user nova-compute[75453]:   </cpu>
Nov 28 14:03:18 user nova-compute[75453]:   <devices>
Nov 28 14:03:18 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:03:18 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:03:18 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk"/>
Nov 28 14:03:18 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:03:18 user nova-compute[75453]:     </disk>
Nov 28 14:03:18 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:03:18 user nova-compute[75453]:       <mac address="fa:16:3e:bd:18:5b"/>
Nov 28 14:03:18 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:03:18 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:03:18 user nova-compute[75453]:       <target dev="tap56d8de7f-0f"/>
Nov 28 14:03:18 user nova-compute[75453]:     </interface>
Nov 28 14:03:18 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:03:18 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/console.log" append="off"/>
Nov 28 14:03:18 user nova-compute[75453]:     </serial>
Nov 28 14:03:18 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:03:18 user nova-compute[75453]:     <video>
Nov 28 14:03:18 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:03:18 user nova-compute[75453]:     </video>
Nov 28 14:03:18 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:03:18 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:03:18 user nova-compute[75453]:     </rng>
Nov 28 14:03:18 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:03:18 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:03:18 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:03:18 user nova-compute[75453]:     </memballoon>
Nov 28 14:03:18 user nova-compute[75453]:   </devices>
Nov 28 14:03:18 user nova-compute[75453]: </domain>
Nov 28 14:03:18 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.objects.instance [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'trusted_certs' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.objects.base [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Cannot resize image /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.objects.instance [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'migration_context' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.objects.base [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Object Instance<10e135e2-a52b-437c-adb6-3fb81daf17e4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1751161168',display_name='tempest-AttachVolumeTestJSON-server-1751161168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1751161168',id=2,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw==',key_name='tempest-keypair-605550184',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-hiprfdzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:01:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=10e135e2-a52b-437c-adb6-3fb81daf17e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG os_vif [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a205e63-6362-5451-bb4e-c5573b4e2282', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56d8de7f-0f, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56d8de7f-0f, col_values=(('qos', UUID('a1633f18-e69a-4912-88b1-ea2c82fcc5d1')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56d8de7f-0f, col_values=(('external_ids', {'iface-id': '56d8de7f-0f8a-4f2e-8890-405ec6cb9294', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:18:5b', 'vm-uuid': '10e135e2-a52b-437c-adb6-3fb81daf17e4'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:18 user nova-compute[75453]: INFO os_vif [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f')
Nov 28 14:03:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:20 user nova-compute[75453]: WARNING nova.compute.manager [req-bae9ab46-136c-40b8-aba6-9074844a7b8d req-b999a032-50ca-45ca-92c1-186759063fbc service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state stopped and task_state powering-on.
Nov 28 14:03:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG nova.compute.manager [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG nova.compute.manager [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:22 user nova-compute[75453]: WARNING nova.compute.manager [req-27ae53fe-6725-4845-b6f0-bbdd171a2870 req-756d6297-632d-4400-8764-652c02ad0dcd service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state stopped and task_state powering-on.
Nov 28 14:03:22 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 is timed out.
Nov 28 14:03:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Successfully detached device vdb from instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 from the live domain config.
Nov 28 14:03:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvgESNbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:03:22 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[18301ede-3545-4c3a-b3fb-9d1480f82d60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:03:22 user nova-compute[75453]: No targets found.
Nov 28 14:03:22 user nova-compute[75453]: iSNS:
Nov 28 14:03:22 user nova-compute[75453]: No targets found.
Nov 28 14:03:22 user nova-compute[75453]: STATIC:
Nov 28 14:03:22 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:03:22 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:22 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:22 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:03:22 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:22 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:22 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:03:22 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:22 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:22 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59
Nov 28 14:03:22 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:22 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:22 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee
Nov 28 14:03:22 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:22 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:22 user nova-compute[75453]: FIRMWARE:
Nov 28 14:03:22 user nova-compute[75453]: No targets found.
Nov 28 14:03:22 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:03:22 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:03:22 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb65cd3-6f65-45c3-a823-d1f7b12b7f8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc968668-a05c-4767-ab14-2fdff743449b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:22 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:22 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:22 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:22 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:22 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:22 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:22 user nova-compute[75453]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee (non-flash)
Nov 28 14:03:22 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:22 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:22 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c2b4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee'): ({'sdf'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Removing single pathed devices sdf {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd2fbf-dd83-4cfd-bdbe-d656e91f6f57]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[197e5cf9-77d5-4cf2-a787-4b518373de91]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Flushing IO for device /dev/sdf {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c94cf29-a6f2-40d3-a1d5-574dd31df343]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd0404-8f73-4b69-b7dc-eb241dbddea9]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] SCSI volumes sdf have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance rebooted successfully.
Nov 28 14:03:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07d57e6f-b2f9-4c4e-a661-06239d432221 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2381fa-6847-4b97-94b2-74de6714d7e0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3733fc88-dd5e-4123-a895-fa153d16db9e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee, portal: 172.16.0.220,3260]
Nov 28 14:03:22 user nova-compute[75453]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee, portal: 172.16.0.220,3260] successful.
Nov 28 14:03:22 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04ffb61-73cd-493b-a46b-810ce0c74dbf]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] <== disconnect_volume: return (310ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:03:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG nova.objects.instance [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'flavor' on Instance uuid e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c0d9c2d-08f0-49fd-957f-992ce8cd7234 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.732s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:23 user nova-compute[75453]: INFO nova.compute.manager [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Terminating instance
Nov 28 14:03:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.compute.manager [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received event network-vif-unplugged-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.compute.manager [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] No waiting events found dispatching network-vif-unplugged-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.compute.manager [req-40f456c9-aed9-4613-8af4-0da9e3898bb9 req-3b1f4ed7-0d31-4494-bccd-c70c78f9cda0 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received event network-vif-unplugged-c559881f-688d-4805-972f-470ba7cb0c3a for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:03:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Instance destroyed successfully.
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.objects.instance [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lazy-loading 'resources' on Instance uuid e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1158935620',display_name='tempest-VolumesSnapshotTestJSON-instance-1158935620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1158935620',id=17,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo93KyRIyDIx6msms3X4P0mECSBfI9u3++xg2wVl/gdDfGrNn7vnL5Abe2nYoJ2jZ7cHhRdKoOxjhf3EPdGbXLAD8XisKL8EhjC44s9aWuBca2URk7mIofayLyn9T2BTA==',key_name='tempest-keypair-89595986',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:00:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff4bdacb213b463cb88e3d046e931b9d',ramdisk_id='',reservation_id='r-giu4q0e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-766520769',owner_user_name='tempest-VolumesSnapshotTestJSON-766520769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='570ac6978fc249ba93d39e40d5d7eac7',uuid=e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converting VIF {"id": "c559881f-688d-4805-972f-470ba7cb0c3a", "address": "fa:16:3e:d5:9d:a1", "network": {"id": "2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-424611893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff4bdacb213b463cb88e3d046e931b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc559881f-68", "ovs_interfaceid": "c559881f-688d-4805-972f-470ba7cb0c3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:9d:a1,bridge_name='br-int',has_traffic_filtering=True,id=c559881f-688d-4805-972f-470ba7cb0c3a,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc559881f-68') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_vif [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:9d:a1,bridge_name='br-int',has_traffic_filtering=True,id=c559881f-688d-4805-972f-470ba7cb0c3a,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc559881f-68') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc559881f-68, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=487ab4fe-c194-4da2-9d53-fc7482091555) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:24 user nova-compute[75453]: INFO os_vif [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:9d:a1,bridge_name='br-int',has_traffic_filtering=True,id=c559881f-688d-4805-972f-470ba7cb0c3a,network=Network(2b6bbdc4-bfd2-49ad-92ab-ffcd92ea5877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc559881f-68')
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvgESNbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:03:24 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0370dfd2-7de9-49bb-a518-f0822358c2f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:03:24 user nova-compute[75453]: No targets found.
Nov 28 14:03:24 user nova-compute[75453]: iSNS:
Nov 28 14:03:24 user nova-compute[75453]: No targets found.
Nov 28 14:03:24 user nova-compute[75453]: STATIC:
Nov 28 14:03:24 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:03:24 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:24 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:24 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:03:24 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:24 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:24 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:03:24 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:24 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:24 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59
Nov 28 14:03:24 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:24 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:24 user nova-compute[75453]: FIRMWARE:
Nov 28 14:03:24 user nova-compute[75453]: No targets found.
Nov 28 14:03:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:03:24 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:03:24 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee665431-8646-4683-a0e1-c392d691e7ee', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2445bb45-ad32-498c-bd8d-1ff6a7f9ba71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1780b5f-de00-40d5-b388-020da7d32f2a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:24 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:24 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:24 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:24 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:24 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:24 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f021878cee0>, {}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Disconnecting from: [] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] <== disconnect_volume: return (75ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:03:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Deleting instance files /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1_del
Nov 28 14:03:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Deletion of /opt/stack/data/nova/instances/e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1_del complete
Nov 28 14:03:24 user nova-compute[75453]: INFO nova.compute.manager [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 28 14:03:24 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:03:24 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:03:25 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:25 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Took 0.89 seconds to deallocate network for instance.
Nov 28 14:03:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received event network-vif-deleted-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:25 user nova-compute[75453]: INFO nova.compute.manager [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Neutron deleted interface c559881f-688d-4805-972f-470ba7cb0c3a; detaching it from the instance and deleting it from the info cache
Nov 28 14:03:25 user nova-compute[75453]: DEBUG nova.network.neutron [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:25 user nova-compute[75453]: WARNING nova.volume.cinder [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Attachment 1220ff64-1dc3-483d-bff8-587bf1089e7b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1220ff64-1dc3-483d-bff8-587bf1089e7b. (HTTP 404) (Request-ID: req-6e0200bc-d309-4a42-91c0-40d78e1af62e)
Nov 28 14:03:25 user nova-compute[75453]: INFO nova.compute.manager [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 14:03:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-839be14b-5d28-46ee-b924-68816f553ea7 req-e48fce48-19ac-4383-8d4b-1f5645531fe3 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Detach interface failed, port_id=c559881f-688d-4805-972f-470ba7cb0c3a, reason: Instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1 could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 14:03:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:26 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:03:26 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:03:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:26 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Deleted allocations for instance e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1
Nov 28 14:03:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf7f919f-2018-49cc-8ed6-80adaba9f643 tempest-VolumesSnapshotTestJSON-766520769 tempest-VolumesSnapshotTestJSON-766520769-project-member] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.591s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received event network-vif-plugged-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] Acquiring lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] Lock "e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] No waiting events found dispatching network-vif-plugged-c559881f-688d-4805-972f-470ba7cb0c3a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:26 user nova-compute[75453]: WARNING nova.compute.manager [req-4796ea1d-bc7b-4fb0-9113-12441cf69bc6 req-dec48ace-3327-4d06-bdc0-8bfa85978bf0 service nova] [instance: e7fab2e9-2c21-4d26-9aa2-33b27d2aeaf1] Received unexpected event network-vif-plugged-c559881f-688d-4805-972f-470ba7cb0c3a for instance with vm_state deleted and task_state None.
Nov 28 14:03:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing instance network info cache due to event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:03:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] Acquiring lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:03:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] Acquired lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:03:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:03:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updated VIF entry in instance network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:03:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-29784a82-e8f5-421e-b0f1-8f19e7c44d61 req-0ba7022a-1bfc-4b4c-8474-dfbb01cf2d14 service nova] Releasing lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:03:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:30 user nova-compute[75453]: INFO nova.compute.manager [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Shelve offloading
Nov 28 14:03:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-unplugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] No waiting events found dispatching network-vif-unplugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:31 user nova-compute[75453]: WARNING nova.compute.manager [req-5f2c8184-7e98-4bce-8284-7195e8c2c4ca req-7919567f-9015-4a36-aa53-d60731349117 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received unexpected event network-vif-unplugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance with vm_state active and task_state shelving.
Nov 28 14:03:31 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Instance destroyed successfully.
Nov 28 14:03:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquired lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:03:31 user nova-compute[75453]: DEBUG nova.network.neutron [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG nova.network.neutron [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Releasing lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:32 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Instance destroyed successfully.
Nov 28 14:03:32 user nova-compute[75453]: DEBUG nova.objects.instance [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lazy-loading 'resources' on Instance uuid 807c145e-9d41-4a76-8777-c033276ba96a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023395681',display_name='tempest-TestShelveInstance-server-1023395681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023395681',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6z3du+pmuEBKboST02586Of9o2SE842jAb049GFnMxRW83rmvet7dpNb4t0VRkhFGxC/tIx+XacRSvu0RJvjpQharev3k6UhzGalKPyeiOSo5afml9y35O1EfkG0ODGQ==',key_name='tempest-TestShelveInstance-1470109784',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:01:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5606d16b2f44aa0a189a0b20d687cbc',ramdisk_id='',reservation_id='r-00jaku0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-511272115',owner_user_name='tempest-TestShelveInstance-511272115-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:01:50Z,user_data=None,user_id='6f9c41c5c12e4ce0b5848dc319ceff1d',uuid=807c145e-9d41-4a76-8777-c033276ba96a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converting VIF {"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_vif [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36fe7f7b-64, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=500381b3-adea-41c3-96a1-a570d39fa7e7) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:32 user nova-compute[75453]: INFO os_vif [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64')
Nov 28 14:03:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPxhjlQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:03:32 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing instance network info cache due to event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] Acquiring lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] Acquired lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49bb34-f04d-4456-a5ed-1f360295f977]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:03:32 user nova-compute[75453]: No targets found.
Nov 28 14:03:32 user nova-compute[75453]: iSNS:
Nov 28 14:03:32 user nova-compute[75453]: No targets found.
Nov 28 14:03:32 user nova-compute[75453]: STATIC:
Nov 28 14:03:32 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:03:32 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:32 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:32 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:03:32 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:32 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:32 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:03:32 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:32 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:32 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59
Nov 28 14:03:32 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:32 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:32 user nova-compute[75453]: FIRMWARE:
Nov 28 14:03:32 user nova-compute[75453]: No targets found.
Nov 28 14:03:32 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:03:32 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:03:32 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c0aacc-e407-4342-8b7d-9b9c24ae648c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d60e9-b535-40c8-9b98-09162db6e9a6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:32 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:32 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:32 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:32 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:32 user nova-compute[75453]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:03:32 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:32 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:32 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02187ad120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59'): ({'sdd'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Removing single pathed devices sdd {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e127f63c-3eac-4803-9d94-ce210ec0daee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6600fb84-fa58-48bf-869b-0e89605e61c6]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Flushing IO for device /dev/sdd {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f30a91-abd5-496c-b2d3-bfc7a8986478]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ec4c9e-eb51-45f7-86dd-b0c3a983a945]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:03:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[04112cd9-4187-48c7-9e80-ff46a9d6c4bc]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef67a419-f2c1-48d3-bc25-5cb84b62372e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260]
Nov 28 14:03:33 user nova-compute[75453]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260] successful.
Nov 28 14:03:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24521e4-9be0-4465-b54d-68bde13b9813]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] <== disconnect_volume: return (349ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:03:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Deleting instance files /opt/stack/data/nova/instances/807c145e-9d41-4a76-8777-c033276ba96a_del
Nov 28 14:03:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Deletion of /opt/stack/data/nova/instances/807c145e-9d41-4a76-8777-c033276ba96a_del complete
Nov 28 14:03:33 user nova-compute[75453]: DEBUG nova.network.neutron [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updated VIF entry in instance network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG nova.network.neutron [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": null, "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5d5207ae-dd90-4893-8e84-0e00576bb376 req-d21478d9-f271-4542-bfb4-e12b602fd017 service nova] Releasing lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] No waiting events found dispatching network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:33 user nova-compute[75453]: WARNING nova.compute.manager [req-27878da0-a173-44f4-9120-a92f9b0e2930 req-e64da521-33e1-4e9b-9081-b50b77b282ed service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received unexpected event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance with vm_state active and task_state shelving.
Nov 28 14:03:34 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Deleted allocations for instance 807c145e-9d41-4a76-8777-c033276ba96a
Nov 28 14:03:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:34 user nova-compute[75453]: DEBUG nova.objects.instance [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lazy-loading 'numa_topology' on Instance uuid 807c145e-9d41-4a76-8777-c033276ba96a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:34 user nova-compute[75453]: DEBUG nova.objects.base [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Object Instance<807c145e-9d41-4a76-8777-c033276ba96a> lazy-loaded attributes: resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:03:34 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:03:34 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:03:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e7f8b722-9d45-4a93-91cd-47c768fe1b23 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.910s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Received event network-changed-d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Refreshing instance network info cache due to event network-changed-d38482f3-db24-4172-a831-de471ef45c2b. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:03:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] Acquiring lock "refresh_cache-3aa772d7-ca30-4a90-b326-3450f9e28784" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:03:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] Acquired lock "refresh_cache-3aa772d7-ca30-4a90-b326-3450f9e28784" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:03:50 user nova-compute[75453]: DEBUG nova.network.neutron [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Refreshing network info cache for port d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:03:50 user nova-compute[75453]: DEBUG nova.network.neutron [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Updated VIF entry in instance network info cache for port d38482f3-db24-4172-a831-de471ef45c2b. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:03:50 user nova-compute[75453]: DEBUG nova.network.neutron [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Updating instance_info_cache with network_info: [{"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-40ee45a9-a26b-4624-8690-37d72b9eba8a req-47e706f1-ada3-4e48-8a3a-0ccc8b2c3722 service nova] Releasing lock "refresh_cache-3aa772d7-ca30-4a90-b326-3450f9e28784" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:03:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "3aa772d7-ca30-4a90-b326-3450f9e28784" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:52 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'flavor' on Instance uuid 3aa772d7-ca30-4a90-b326-3450f9e28784 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "3aa772d7-ca30-4a90-b326-3450f9e28784" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:53 user nova-compute[75453]: INFO nova.compute.manager [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Attaching volume 2b014d0c-d9b1-480f-b41e-ddcd60515bef to /dev/vdb
Nov 28 14:03:53 user nova-compute[75453]: DEBUG os_brick.utils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf95a6c2-12a3-49d5-bc98-16a3507d35de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1232383-c10e-45a0-91e9-914dac98584e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f428ff83-1c00-4886-9ab7-4209337ce734]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5d2678-2eb1-4698-9b87-5c9776570f32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:03:53 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:03:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0031d88f-64b4-4541-8bc7-3960b3f569fb]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG os_brick.utils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:03:53 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Updating existing volume attachment record: f0a15930-cf6f-4d0f-ae79-1d86e9289882 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "48dd0221-4935-4ee2-9958-90a748fe5255" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "48dd0221-4935-4ee2-9958-90a748fe5255" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:55 user nova-compute[75453]: INFO nova.compute.manager [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Terminating instance
Nov 28 14:03:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received event network-vif-unplugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] Acquiring lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] No waiting events found dispatching network-vif-unplugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-c4db3506-453c-44eb-bdf1-e79f72563570 req-4e44bbef-b31f-4534-bd37-7d0edfc3d789 service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received event network-vif-unplugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:56 user nova-compute[75453]: INFO nova.compute.manager [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Terminating instance
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:03:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Instance destroyed successfully.
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lazy-loading 'resources' on Instance uuid 48dd0221-4935-4ee2-9958-90a748fe5255 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1356482257',display_name='tempest-ServersNegativeTestJSON-server-1356482257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1356482257',id=1,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f9642956daa4507a3b6791bcd41d9d3',ramdisk_id='',reservation_id='r-3ru08h5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2071230602',owner_user_name='tempest-ServersNegativeTestJSON-2071230602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T13:55:25Z,user_data=None,user_id='237e50c8ccfa49169a1bdca99f46e616',uuid=48dd0221-4935-4ee2-9958-90a748fe5255,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converting VIF {"id": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "address": "fa:16:3e:5d:0a:d8", "network": {"id": "73322956-2161-4c75-88f6-ddf480017fbe", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-648370076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f9642956daa4507a3b6791bcd41d9d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea53315f-4a", "ovs_interfaceid": "ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:0a:d8,bridge_name='br-int',has_traffic_filtering=True,id=ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea53315f-4a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG os_vif [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:0a:d8,bridge_name='br-int',has_traffic_filtering=True,id=ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea53315f-4a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea53315f-4a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=332f65e9-e5fd-4850-94f8-2e8d7cc01cba) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:56 user nova-compute[75453]: INFO os_vif [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:0a:d8,bridge_name='br-int',has_traffic_filtering=True,id=ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f,network=Network(73322956-2161-4c75-88f6-ddf480017fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea53315f-4a')
Nov 28 14:03:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Deleting instance files /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255_del
Nov 28 14:03:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Deletion of /opt/stack/data/nova/instances/48dd0221-4935-4ee2-9958-90a748fe5255_del complete
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:56 user nova-compute[75453]: INFO nova.compute.manager [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 28 14:03:56 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-unplugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-unplugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-9c48e3a5-1611-44ac-81e6-a102386246c8 req-825f730b-cafc-498f-a59a-07a24646bc3e service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-unplugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:03:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Instance destroyed successfully.
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.objects.instance [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lazy-loading 'resources' on Instance uuid 9a32cb51-7b87-4d9b-9e94-72cb60f4371f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-370204766',display_name='tempest-ServerActionsTestOtherB-server-370204766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-370204766',id=3,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIawPvCyz5NPB8DnADrJrc8owStJqbeTCONa7Go83RNYuSXkpqOnK1WP1WObxQdw7X1gjg0x35YFuLpoVPHP+O4uU1yWdN3Hlg69Gcrc9+34kX8jAfLcPeq0l7ACMVcIg==',key_name='tempest-keypair-2095208703',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d326de84f8224cef95e650bd92e7198f',ramdisk_id='',reservation_id='r-0iqcbio7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1799325713',owner_user_name='tempest-ServerActionsTestOtherB-1799325713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:01:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14da9954e4fc44deb3c603165b10cf66',uuid=9a32cb51-7b87-4d9b-9e94-72cb60f4371f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converting VIF {"id": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "address": "fa:16:3e:c0:6b:2f", "network": {"id": "a4074972-6f6c-4057-aaf4-84820b2e0c57", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-888760304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d326de84f8224cef95e650bd92e7198f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36d6817d-5a", "ovs_interfaceid": "36d6817d-5a86-4e22-90cd-adfe2b3f176e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_vif [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36d6817d-5a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb61cd09-191e-467a-a840-6cad3e1f450b) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:57 user nova-compute[75453]: INFO os_vif [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6b:2f,bridge_name='br-int',has_traffic_filtering=True,id=36d6817d-5a86-4e22-90cd-adfe2b3f176e,network=Network(a4074972-6f6c-4057-aaf4-84820b2e0c57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36d6817d-5a')
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LoMBphND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:03:57 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[831a007b-ea24-466d-b35a-9791e4f7ad5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:03:57 user nova-compute[75453]: No targets found.
Nov 28 14:03:57 user nova-compute[75453]: iSNS:
Nov 28 14:03:57 user nova-compute[75453]: No targets found.
Nov 28 14:03:57 user nova-compute[75453]: STATIC:
Nov 28 14:03:57 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:03:57 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:57 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:57 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1
Nov 28 14:03:57 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:57 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:57 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:03:57 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:03:57 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:03:57 user nova-compute[75453]: FIRMWARE:
Nov 28 14:03:57 user nova-compute[75453]: No targets found.
Nov 28 14:03:57 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:03:57 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:03:57 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd8a3b6-526b-4ed9-902f-278cbecfe475]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Took 0.67 seconds to deallocate network for instance.
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba593a7e-2732-456b-8b0a-8f99a6adba89]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:57 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:57 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:57 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 (non-flash)
Nov 28 14:03:57 user nova-compute[75453]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:03:57 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:03:57 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02187afc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc4450-0746-4d29-a426-ba446fef92cb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e47a5e-3ed1-4bb1-8dd1-43f2fa0412a3]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d831189-e14e-4b94-8265-f01aa72a5dee]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[404ec945-1f8b-4bca-a47f-1c6b3c74ac16]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8c0455-744b-4a06-8c31-8a975e02f2db]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[444c9b70-83b4-4786-82cd-3f54105e4a3d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260]
Nov 28 14:03:57 user nova-compute[75453]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1, portal: 172.16.0.220,3260] successful.
Nov 28 14:03:57 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95820667-5de5-45e2-a99e-67643abf1bb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[90abc5de-50f0-4d70-a7f2-bca7a5ff98ef]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] <== disconnect_volume: return (353ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:03:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Deleting instance files /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f_del
Nov 28 14:03:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Deletion of /opt/stack/data/nova/instances/9a32cb51-7b87-4d9b-9e94-72cb60f4371f_del complete
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:03:57 user nova-compute[75453]: INFO nova.compute.manager [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:57 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Deleted allocations for instance 48dd0221-4935-4ee2-9958-90a748fe5255
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d57ff3e1-d949-4f7f-8846-3ea37697573d tempest-ServersNegativeTestJSON-2071230602 tempest-ServersNegativeTestJSON-2071230602-project-member] Lock "48dd0221-4935-4ee2-9958-90a748fe5255" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.300s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received event network-vif-plugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] Acquiring lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] Lock "48dd0221-4935-4ee2-9958-90a748fe5255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] No waiting events found dispatching network-vif-plugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:57 user nova-compute[75453]: WARNING nova.compute.manager [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received unexpected event network-vif-plugged-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f for instance with vm_state deleted and task_state None.
Nov 28 14:03:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-d0e99de5-0077-4e86-9c3a-cc3399671557 req-3c5e2995-8c3b-422a-a9b5-15838c79127e service nova] [instance: 48dd0221-4935-4ee2-9958-90a748fe5255] Received event network-vif-deleted-ea53315f-4ac6-4ef5-a06c-cdd0b4aa233f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:58 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:03:58 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Took 1.06 seconds to deallocate network for instance.
Nov 28 14:03:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] Acquiring lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:03:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] No waiting events found dispatching network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:03:58 user nova-compute[75453]: WARNING nova.compute.manager [req-fd6c7c67-38f4-4985-a51f-319365d9bdab req-3f374cb6-82b6-4b23-a4d4-95e201869611 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received unexpected event network-vif-plugged-36d6817d-5a86-4e22-90cd-adfe2b3f176e for instance with vm_state active and task_state deleting.
Nov 28 14:03:59 user nova-compute[75453]: INFO nova.compute.manager [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Took 0.87 seconds to detach 1 volumes for instance.
Nov 28 14:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:03:59 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:03:59 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:03:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:03:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-87750d40-45f6-4703-a983-57b598723255 req-ecf05a18-7d87-4967-b493-1aba17bc2346 service nova] [instance: 9a32cb51-7b87-4d9b-9e94-72cb60f4371f] Received event network-vif-deleted-36d6817d-5a86-4e22-90cd-adfe2b3f176e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:00 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Deleted allocations for instance 9a32cb51-7b87-4d9b-9e94-72cb60f4371f
Nov 28 14:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-877692f3-2045-4a11-844d-0af4415ab09c tempest-ServerActionsTestOtherB-1799325713 tempest-ServerActionsTestOtherB-1799325713-project-member] Lock "9a32cb51-7b87-4d9b-9e94-72cb60f4371f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.858s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilZCopRm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:04:01 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:04:01 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:04:01 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaedaf8-a57a-4468-9f82-7067a367b52b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:04:01 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b51873-1c05-4ea9-8b55-315fd2eadab7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef] added
Nov 28 14:04:01 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e92b656-a01f-42e2-b787-9c94bfca1b11]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c09529-df2a-4a9a-acee-daadb4fdfcfa]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilZCopRm {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilZCopRm" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae7c96-ee1a-422f-94fc-c81ecf6d60e6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ilZCopRm'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8688d-c272-47d9-804c-c16c9d8a8a37]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d099aa-e8f6-4e01-ab62-3f55fc1f41b9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:01 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:01 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:01 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:01 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9e77c2-31e0-4c6b-ba79-903ec38901bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef, portal: 172.16.0.220,3260]
Nov 28 14:04:01 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef, portal: 172.16.0.220,3260] successful.
Nov 28 14:04:01 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2985f287-e968-43b7-9dd1-e09e2ac9c603]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8093dce-b983-4417-849e-c2d44316e6f7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:02 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:02 user nova-compute[75453]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)
Nov 28 14:04:02 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:02 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:02 user nova-compute[75453]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)
Nov 28 14:04:02 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[792dbeae-a66c-4144-a652-965271917457]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilZCopRm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23130663739396630', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130663739396630', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'flavor' on Instance uuid 3aa772d7-ca30-4a90-b326-3450f9e28784 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:04:03 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:04:03 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:04:03 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:04:03 user nova-compute[75453]:   <serial>2b014d0c-d9b1-480f-b41e-ddcd60515bef</serial>
Nov 28 14:04:03 user nova-compute[75453]: </disk>
Nov 28 14:04:03 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:04:03 user nova-compute[75453]: INFO nova.compute.claims [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Claim successful on node user
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No VIF found with MAC fa:16:3e:e3:e9:52, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d8673560-366d-4d03-ad9c-f4ec9462397b tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.640s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:04:03 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:04:04 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.policy [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:04:04 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Creating image(s)
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "/opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "/opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "/opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "3aa772d7-ca30-4a90-b326-3450f9e28784" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:04 user nova-compute[75453]: INFO nova.compute.manager [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Detaching volume 2b014d0c-d9b1-480f-b41e-ddcd60515bef
Nov 28 14:04:04 user nova-compute[75453]: INFO nova.virt.block_device [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Attempting to driver detach volume 2b014d0c-d9b1-480f-b41e-ddcd60515bef from mountpoint /dev/vdb
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk 1073741824" returned: 0 in 0.059s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Successfully created port: 51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Attempting to detach device vdb from instance 3aa772d7-ca30-4a90-b326-3450f9e28784 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:04:04 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:04:04 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:04:04 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:04:04 user nova-compute[75453]:   <serial>2b014d0c-d9b1-480f-b41e-ddcd60515bef</serial>
Nov 28 14:04:04 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:04:04 user nova-compute[75453]: </disk>
Nov 28 14:04:04 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:04:04 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully detached device vdb from instance 3aa772d7-ca30-4a90-b326-3450f9e28784 from the persistent domain config.
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3aa772d7-ca30-4a90-b326-3450f9e28784 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:04:04 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:04:04 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:04:04 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:04:04 user nova-compute[75453]:   <serial>2b014d0c-d9b1-480f-b41e-ddcd60515bef</serial>
Nov 28 14:04:04 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:04:04 user nova-compute[75453]: </disk>
Nov 28 14:04:04 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:04:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Cannot resize image /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Ensure instance console log exists: /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3aa772d7-ca30-4a90-b326-3450f9e28784 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Successfully updated port: 51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquired lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received event network-changed-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Refreshing instance network info cache due to event network-changed-51520e6e-9061-4b7f-8860-53b7cfa9028a. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] Acquiring lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updating instance_info_cache with network_info: [{"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Releasing lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Instance network_info: |[{"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] Acquired lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.network.neutron [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Refreshing network info cache for port 51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Start _get_guest_xml network_info=[{"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:04:05 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:04:05 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:04:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:04:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441434432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441434432',id=23,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-aqanvuny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:04:04Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=839b0b0f-101d-46ca-97a8-ab404cc35ea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:92:97,bridge_name='br-int',has_traffic_filtering=True,id=51520e6e-9061-4b7f-8860-53b7cfa9028a,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51520e6e-90') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.objects.instance [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'pci_devices' on Instance uuid 839b0b0f-101d-46ca-97a8-ab404cc35ea9 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:04:06 user nova-compute[75453]:   <uuid>839b0b0f-101d-46ca-97a8-ab404cc35ea9</uuid>
Nov 28 14:04:06 user nova-compute[75453]:   <name>instance-00000017</name>
Nov 28 14:04:06 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:04:06 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:04:06 user nova-compute[75453]:   <metadata>
Nov 28 14:04:06 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:04:06 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:04:06 user nova-compute[75453]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-441434432</nova:name>
Nov 28 14:04:06 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:04:05</nova:creationTime>
Nov 28 14:04:06 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:04:06 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:04:06 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:04:06 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:04:06 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:04:06 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:04:06 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:04:06 user nova-compute[75453]:       <nova:owner>
Nov 28 14:04:06 user nova-compute[75453]:         <nova:user uuid="f88c92554f0f44b0be661aa40aec8670">tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member</nova:user>
Nov 28 14:04:06 user nova-compute[75453]:         <nova:project uuid="3de3b398da714d8cb92fad7f64d5c64e">tempest-ServerBootFromVolumeStableRescueTest-682344680</nova:project>
Nov 28 14:04:06 user nova-compute[75453]:       </nova:owner>
Nov 28 14:04:06 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:04:06 user nova-compute[75453]:       <nova:ports>
Nov 28 14:04:06 user nova-compute[75453]:         <nova:port uuid="51520e6e-9061-4b7f-8860-53b7cfa9028a">
Nov 28 14:04:06 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 14:04:06 user nova-compute[75453]:         </nova:port>
Nov 28 14:04:06 user nova-compute[75453]:       </nova:ports>
Nov 28 14:04:06 user nova-compute[75453]:     </nova:instance>
Nov 28 14:04:06 user nova-compute[75453]:   </metadata>
Nov 28 14:04:06 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:04:06 user nova-compute[75453]:     <system>
Nov 28 14:04:06 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:04:06 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:04:06 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:04:06 user nova-compute[75453]:       <entry name="serial">839b0b0f-101d-46ca-97a8-ab404cc35ea9</entry>
Nov 28 14:04:06 user nova-compute[75453]:       <entry name="uuid">839b0b0f-101d-46ca-97a8-ab404cc35ea9</entry>
Nov 28 14:04:06 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:04:06 user nova-compute[75453]:     </system>
Nov 28 14:04:06 user nova-compute[75453]:   </sysinfo>
Nov 28 14:04:06 user nova-compute[75453]:   <os>
Nov 28 14:04:06 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:04:06 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:04:06 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:04:06 user nova-compute[75453]:   </os>
Nov 28 14:04:06 user nova-compute[75453]:   <features>
Nov 28 14:04:06 user nova-compute[75453]:     <acpi/>
Nov 28 14:04:06 user nova-compute[75453]:     <apic/>
Nov 28 14:04:06 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:04:06 user nova-compute[75453]:   </features>
Nov 28 14:04:06 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:04:06 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:04:06 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:04:06 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:04:06 user nova-compute[75453]:   </clock>
Nov 28 14:04:06 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:04:06 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:04:06 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:04:06 user nova-compute[75453]:   </cpu>
Nov 28 14:04:06 user nova-compute[75453]:   <devices>
Nov 28 14:04:06 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:04:06 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:04:06 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk"/>
Nov 28 14:04:06 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:04:06 user nova-compute[75453]:     </disk>
Nov 28 14:04:06 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:04:06 user nova-compute[75453]:       <mac address="fa:16:3e:9e:92:97"/>
Nov 28 14:04:06 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:04:06 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:04:06 user nova-compute[75453]:       <target dev="tap51520e6e-90"/>
Nov 28 14:04:06 user nova-compute[75453]:     </interface>
Nov 28 14:04:06 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:04:06 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/console.log" append="off"/>
Nov 28 14:04:06 user nova-compute[75453]:     </serial>
Nov 28 14:04:06 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:04:06 user nova-compute[75453]:     <video>
Nov 28 14:04:06 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:04:06 user nova-compute[75453]:     </video>
Nov 28 14:04:06 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:04:06 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:04:06 user nova-compute[75453]:     </rng>
Nov 28 14:04:06 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:04:06 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:04:06 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:04:06 user nova-compute[75453]:     </memballoon>
Nov 28 14:04:06 user nova-compute[75453]:   </devices>
Nov 28 14:04:06 user nova-compute[75453]: </domain>
Nov 28 14:04:06 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:04:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441434432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441434432',id=23,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-aqanvuny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:04:04Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=839b0b0f-101d-46ca-97a8-ab404cc35ea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:92:97,bridge_name='br-int',has_traffic_filtering=True,id=51520e6e-9061-4b7f-8860-53b7cfa9028a,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51520e6e-90') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG os_vif [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:92:97,bridge_name='br-int',has_traffic_filtering=True,id=51520e6e-9061-4b7f-8860-53b7cfa9028a,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51520e6e-90') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e3dc67b-fb5c-51ff-b0b3-a29642056ef2', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51520e6e-90, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51520e6e-90, col_values=(('qos', UUID('0e907113-dde0-416e-9891-f36cfa18a93d')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51520e6e-90, col_values=(('external_ids', {'iface-id': '51520e6e-9061-4b7f-8860-53b7cfa9028a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:92:97', 'vm-uuid': '839b0b0f-101d-46ca-97a8-ab404cc35ea9'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:06 user nova-compute[75453]: INFO os_vif [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:92:97,bridge_name='br-int',has_traffic_filtering=True,id=51520e6e-9061-4b7f-8860-53b7cfa9028a,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51520e6e-90')
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No VIF found with MAC fa:16:3e:9e:92:97, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updated VIF entry in instance network info cache for port 51520e6e-9061-4b7f-8860-53b7cfa9028a. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updating instance_info_cache with network_info: [{"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:04:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-54c311ea-83c6-4c6a-9352-f02b65d55251 req-a442478d-283e-443f-addf-a1d1f894b69e service nova] Releasing lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received event network-vif-plugged-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] Acquiring lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] No waiting events found dispatching network-vif-plugged-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:04:07 user nova-compute[75453]: WARNING nova.compute.manager [req-9d34e08e-0aac-47c7-b72b-e778abd12ed7 req-e3d94b20-0d72-4838-92cb-e470e10c26ba service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received unexpected event network-vif-plugged-51520e6e-9061-4b7f-8860-53b7cfa9028a for instance with vm_state building and task_state spawning.
Nov 28 14:04:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:04:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:04:09 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Instance spawned successfully.
Nov 28 14:04:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received event network-vif-plugged-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] Acquiring lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] No waiting events found dispatching network-vif-plugged-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:04:10 user nova-compute[75453]: WARNING nova.compute.manager [req-a54c8d7d-4e81-4fad-9703-664f00cfac1e req-67ec4ccb-b8e7-410b-93c9-49f7969dc5c1 service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received unexpected event network-vif-plugged-51520e6e-9061-4b7f-8860-53b7cfa9028a for instance with vm_state building and task_state spawning.
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:04:10 user nova-compute[75453]: INFO nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:10 user nova-compute[75453]: INFO nova.compute.manager [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Took 6.76 seconds to build instance.
Nov 28 14:04:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eccb666d-205a-479c-a51e-7ec1c27f412f tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.864s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:04:10 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:04:10 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7718MB free_disk=25.414474487304688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance ea32aeb2-975a-4295-aeb6-12e177657219 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 6466bc94-8a78-4541-a864-9f0370b212c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 3aa772d7-ca30-4a90-b326-3450f9e28784 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 2d3e50a0-3428-42c7-aee0-baa85761b734 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:04:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:04:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:11 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:04:11 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:04:11 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:04:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating instance_info_cache with network_info: [{"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-10e135e2-a52b-437c-adb6-3fb81daf17e4" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:04:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:04:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "2d3e50a0-3428-42c7-aee0-baa85761b734" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lazy-loading 'flavor' on Instance uuid 2d3e50a0-3428-42c7-aee0-baa85761b734 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "2d3e50a0-3428-42c7-aee0-baa85761b734" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:16 user nova-compute[75453]: INFO nova.compute.manager [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Attaching volume 41f6f108-0e4f-45c9-9f7a-960844609545 to /dev/vdb
Nov 28 14:04:16 user nova-compute[75453]: DEBUG os_brick.utils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3710b5b0-f704-419f-ba3c-862b9cf5712d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[56744904-9b8c-4580-ae49-97363fc76877]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[20149c7c-6968-4ec0-8bf4-1ba6ca29f143]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f507bf82-d5c7-4e04-bfd9-6f297a1246ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:04:16 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:04:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1de703-7ee9-4a52-9af0-f260cae3a85e]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG os_brick.utils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:04:16 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Updating existing volume attachment record: 58a631fb-764b-46f7-94bf-377e90e86b5a {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:04:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npqcORID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:04:23 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:04:23 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:04:23 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0301f9-bd6a-4d49-af13-7bd804a7e661]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:04:23 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[87919046-eb0a-4725-be7b-43ae1391cc0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545] added
Nov 28 14:04:23 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[38088116-cdc8-4d20-9c48-36766edcaf73]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[df35e19a-239c-43c1-990d-0f6a017e776f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npqcORID {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npqcORID" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef1d12-ce76-40fe-a621-f8c5a7bba89c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npqcORID'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b05ade-7fd9-4237-aaed-26d14e63c318]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[875d51f2-c981-4ccf-b3fd-db94616c5d67]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:23 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:23 user nova-compute[75453]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)
Nov 28 14:04:23 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:23 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:23 user nova-compute[75453]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)
Nov 28 14:04:23 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:04:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53e33d0-df7d-4aa0-8ca1-93102452f115]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545, portal: 172.16.0.220,3260]
Nov 28 14:04:24 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545, portal: 172.16.0.220,3260] successful.
Nov 28 14:04:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b3c9c8-acbc-4cea-ab25-5a80ed0fefc1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d1a4c3-1f9a-4013-b8b6-fef551591082]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:24 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:24 user nova-compute[75453]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)
Nov 28 14:04:24 user nova-compute[75453]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)
Nov 28 14:04:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:24 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:24 user nova-compute[75453]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)
Nov 28 14:04:24 user nova-compute[75453]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)
Nov 28 14:04:24 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdd0154-5cdf-49cb-a980-91fbc1f75d69]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:04:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npqcORID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23332323065626161', 'path': '/dev/sdd'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332323065626161', 'path': '/dev/sdd'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lazy-loading 'flavor' on Instance uuid 2d3e50a0-3428-42c7-aee0-baa85761b734 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:04:25 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3aa772d7-ca30-4a90-b326-3450f9e28784 is timed out.
Nov 28 14:04:25 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully detached device vdb from instance 3aa772d7-ca30-4a90-b326-3450f9e28784 from the live domain config.
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:04:25 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:04:25 user nova-compute[75453]:   <source dev="/dev/sdd"/>
Nov 28 14:04:25 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:04:25 user nova-compute[75453]:   <serial>41f6f108-0e4f-45c9-9f7a-960844609545</serial>
Nov 28 14:04:25 user nova-compute[75453]: </disk>
Nov 28 14:04:25 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilZCopRm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:04:25 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[471ec261-3226-4680-82c0-9ae5230e27b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:04:25 user nova-compute[75453]: No targets found.
Nov 28 14:04:25 user nova-compute[75453]: iSNS:
Nov 28 14:04:25 user nova-compute[75453]: No targets found.
Nov 28 14:04:25 user nova-compute[75453]: STATIC:
Nov 28 14:04:25 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:04:25 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:04:25 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:04:25 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545
Nov 28 14:04:25 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:04:25 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:04:25 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef
Nov 28 14:04:25 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:04:25 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:04:25 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:04:25 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:04:25 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:04:25 user nova-compute[75453]: FIRMWARE:
Nov 28 14:04:25 user nova-compute[75453]: No targets found.
Nov 28 14:04:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:04:25 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:04:25 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ca50f7-43a7-494d-be1a-c89240d4101c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "6466bc94-8a78-4541-a864-9f0370b212c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[241deec8-9049-4efa-885d-393445de77d6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:25 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:25 user nova-compute[75453]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)
Nov 28 14:04:25 user nova-compute[75453]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)
Nov 28 14:04:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:25 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:25 user nova-compute[75453]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef (non-flash)
Nov 28 14:04:25 user nova-compute[75453]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)
Nov 28 14:04:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02187df2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:04:25 user nova-compute[75453]: INFO nova.compute.manager [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Terminating instance
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f10576e-4db3-41a5-aa66-93ac91b86e30]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8517d50c-2bc0-45ae-b335-11941a2c764a]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b4b01-182d-4e28-b2e6-90044153be7f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2754a5-3a58-437b-a424-266dc5e6dbcd]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed81ce3a-f9cb-4cd4-8b4a-ffaf8647c802]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba60bdea-8c2e-4929-bc7b-6d828cd62051]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef, portal: 172.16.0.220,3260]
Nov 28 14:04:25 user nova-compute[75453]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef, portal: 172.16.0.220,3260] successful.
Nov 28 14:04:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b014d0c-d9b1-480f-b41e-ddcd60515bef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bb9b3c-3d35-4038-927a-7de83f13eb1e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] <== disconnect_volume: return (413ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-unplugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] No waiting events found dispatching network-vif-unplugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-0f5dbd9c-5d8d-4a9a-a744-4a3ac05f835c req-807b687b-9a7c-4e21-8869-95d36d36bafd service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-unplugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:04:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] No VIF found with MAC fa:16:3e:5d:4e:f2, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b0ab953c-99c3-48ff-9507-d148bf11d8de tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.431s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Instance destroyed successfully.
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lazy-loading 'resources' on Instance uuid 6466bc94-8a78-4541-a864-9f0370b212c1 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1664826618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1576957829',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhCE1KdXUl0gyKQN8cxHdQBSdoIOXAXck9gShrFsDuTComCOmZg1HXlk/E0PRpSF3JI/duBB0wGIY1DEhRduzsv/cvgYCVHRukYUjTiF6VZpcGAYot9rGCCTrNA5JY+6g==',key_name='tempest-keypair-1958037787',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:03:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbf581e03a6c4f678536c9d64fe4b8cc',ramdisk_id='',reservation_id='r-le3gxts7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2097640131',owner_user_name='tempest-ServerActionsV293TestJSON-2097640131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1406382a40d841b5a59d791ec6744fc4',uuid=6466bc94-8a78-4541-a864-9f0370b212c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converting VIF {"id": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "address": "fa:16:3e:c7:e0:b2", "network": {"id": "c97ad9fa-d1d9-4437-99e9-6a2856546feb", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1552803529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbf581e03a6c4f678536c9d64fe4b8cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85d8e95-00", "ovs_interfaceid": "f85d8e95-0038-4312-bfc1-28b0a2354a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_vif [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf85d8e95-00, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d244e5cb-9f0d-4ac6-853f-0be237099e6a) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: INFO os_vif [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e0:b2,bridge_name='br-int',has_traffic_filtering=True,id=f85d8e95-0038-4312-bfc1-28b0a2354a09,network=Network(c97ad9fa-d1d9-4437-99e9-6a2856546feb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85d8e95-00')
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMKPzAfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:04:26 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0603723-29e0-45ce-a398-0a2515af6fc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:04:26 user nova-compute[75453]: No targets found.
Nov 28 14:04:26 user nova-compute[75453]: iSNS:
Nov 28 14:04:26 user nova-compute[75453]: No targets found.
Nov 28 14:04:26 user nova-compute[75453]: STATIC:
Nov 28 14:04:26 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055
Nov 28 14:04:26 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:04:26 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:04:26 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545
Nov 28 14:04:26 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:04:26 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:04:26 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:04:26 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:04:26 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:04:26 user nova-compute[75453]: FIRMWARE:
Nov 28 14:04:26 user nova-compute[75453]: No targets found.
Nov 28 14:04:26 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:04:26 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:04:26 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3579ae91-0b9c-41d7-bfb0-f4fa7f0492f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdab68f-482a-4da6-b54b-5ebf5e18cbd7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:26 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:26 user nova-compute[75453]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)
Nov 28 14:04:26 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:26 user nova-compute[75453]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 (non-flash)
Nov 28 14:04:26 user nova-compute[75453]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)
Nov 28 14:04:26 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c5a2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055'): ({'sde'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Removing single pathed devices sde {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5f46fa-a11e-48f2-9196-31e9549f0a92]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce77928-1e56-4ae2-89b8-abd41f1bb68a]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Flushing IO for device /dev/sde {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4ee06d-e9a4-4402-97d0-fb1ac1440c97]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "2d3e50a0-3428-42c7-aee0-baa85761b734" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:26 user nova-compute[75453]: INFO nova.compute.manager [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Terminating instance
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc20af7-5048-4bf1-9c91-55b2b9dbe9a2]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dfde83-462f-4cab-9432-1d1c9b3c1796]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.objects.instance [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'flavor' on Instance uuid 3aa772d7-ca30-4a90-b326-3450f9e28784 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ae9517-676f-43f1-ad7a-5fcf6c072c32]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260]
Nov 28 14:04:26 user nova-compute[75453]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055, portal: 172.16.0.220,3260] successful.
Nov 28 14:04:26 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bbc90b3-d676-465d-8b27-6af2a82d5055 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb6da10-51d4-4c26-b943-66352ffa3fdd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] <== disconnect_volume: return (373ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:04:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Deleting instance files /opt/stack/data/nova/instances/6466bc94-8a78-4541-a864-9f0370b212c1_del
Nov 28 14:04:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Deletion of /opt/stack/data/nova/instances/6466bc94-8a78-4541-a864-9f0370b212c1_del complete
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8a3fb5fc-ad64-4972-8462-df2389ef66bf tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.180s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:26 user nova-compute[75453]: INFO nova.compute.manager [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received event network-vif-unplugged-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] Acquiring lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] No waiting events found dispatching network-vif-unplugged-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:04:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-3b828027-01b7-43aa-a22d-7b3c26ccf468 req-22e47c27-ab0b-41d0-997f-70a13ed7133d service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received event network-vif-unplugged-af80811d-0d53-4367-88e4-0a688c183350 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:04:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Instance destroyed successfully.
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.objects.instance [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lazy-loading 'resources' on Instance uuid 2d3e50a0-3428-42c7-aee0-baa85761b734 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1739476838',display_name='tempest-DeleteServersTestJSON-server-1739476838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1739476838',id=21,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cec039db477464e97d27271375d7787',ramdisk_id='',reservation_id='r-f9y1no7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-283705446',owner_user_name='tempest-DeleteServersTestJSON-283705446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:02:30Z,user_data=None,user_id='f72e0ee68948479fa09697af3cf24b4b',uuid=2d3e50a0-3428-42c7-aee0-baa85761b734,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Converting VIF {"id": "af80811d-0d53-4367-88e4-0a688c183350", "address": "fa:16:3e:5d:4e:f2", "network": {"id": "8b43f52b-7c66-43d0-a042-a7cbace5ffcb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1808135155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cec039db477464e97d27271375d7787", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf80811d-0d", "ovs_interfaceid": "af80811d-0d53-4367-88e4-0a688c183350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=af80811d-0d53-4367-88e4-0a688c183350,network=Network(8b43f52b-7c66-43d0-a042-a7cbace5ffcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf80811d-0d') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_vif [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=af80811d-0d53-4367-88e4-0a688c183350,network=Network(8b43f52b-7c66-43d0-a042-a7cbace5ffcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf80811d-0d') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf80811d-0d, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa4dd2ad-887b-41d0-a35e-1004af3342fc) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:04:27 user nova-compute[75453]: INFO os_vif [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=af80811d-0d53-4367-88e4-0a688c183350,network=Network(8b43f52b-7c66-43d0-a042-a7cbace5ffcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf80811d-0d')
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npqcORID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:04:27 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8459681-8389-4d2f-af49-b18eaf6e240e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:04:27 user nova-compute[75453]: No targets found.
Nov 28 14:04:27 user nova-compute[75453]: iSNS:
Nov 28 14:04:27 user nova-compute[75453]: No targets found.
Nov 28 14:04:27 user nova-compute[75453]: STATIC:
Nov 28 14:04:27 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545
Nov 28 14:04:27 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:04:27 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:04:27 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:04:27 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:04:27 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:04:27 user nova-compute[75453]: FIRMWARE:
Nov 28 14:04:27 user nova-compute[75453]: No targets found.
Nov 28 14:04:27 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:04:27 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:04:27 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87b6315-c79c-4364-99f0-867e4ba4468d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5469a788-4d53-4f41-a7d6-6e81a6fe54c2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:27 user nova-compute[75453]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)
Nov 28 14:04:27 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:04:27 user nova-compute[75453]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 (non-flash)
Nov 28 14:04:27 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02540d9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545'): ({'sdd'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Removing single pathed devices sdd {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6d5883-bebe-42e3-803d-c14d5ba2b567]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c932f651-8109-48a9-83fa-b334f2121a7f]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Flushing IO for device /dev/sdd {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbf6626-7d78-4a8e-bf88-3611689f44e6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:04:27 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Took 0.74 seconds to deallocate network for instance.
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee938fef-0953-46f7-a557-1fdc7a734944]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d486f0-d453-4324-8caf-b7a75352cf18]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8bde4c-67a4-4cf5-9f9f-c559eedf3279]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545, portal: 172.16.0.220,3260]
Nov 28 14:04:27 user nova-compute[75453]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545, portal: 172.16.0.220,3260] successful.
Nov 28 14:04:27 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f6f108-0e4f-45c9-9f7a-960844609545 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[42775c24-1214-46f3-8862-ad0fab579542]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] <== disconnect_volume: return (297ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:04:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Deleting instance files /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734_del
Nov 28 14:04:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Deletion of /opt/stack/data/nova/instances/2d3e50a0-3428-42c7-aee0-baa85761b734_del complete
Nov 28 14:04:27 user nova-compute[75453]: INFO nova.compute.manager [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] Acquiring lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] Lock "6466bc94-8a78-4541-a864-9f0370b212c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] No waiting events found dispatching network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:04:27 user nova-compute[75453]: WARNING nova.compute.manager [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received unexpected event network-vif-plugged-f85d8e95-0038-4312-bfc1-28b0a2354a09 for instance with vm_state active and task_state deleting.
Nov 28 14:04:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-3abc4f0c-828a-4281-ba40-0e25f338126e req-f67d732f-dfb1-4af8-b076-c54110ef6743 service nova] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Received event network-vif-deleted-f85d8e95-0038-4312-bfc1-28b0a2354a09 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:04:28 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Took 0.45 seconds to deallocate network for instance.
Nov 28 14:04:28 user nova-compute[75453]: INFO nova.compute.manager [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Took 0.76 seconds to detach 1 volumes for instance.
Nov 28 14:04:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] [instance: 6466bc94-8a78-4541-a864-9f0370b212c1] Deleting volume: 0bbc90b3-d676-465d-8b27-6af2a82d5055 {{(pid=75453) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:28 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Deleted allocations for instance 6466bc94-8a78-4541-a864-9f0370b212c1
Nov 28 14:04:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received event network-vif-plugged-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] Acquiring lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] No waiting events found dispatching network-vif-plugged-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:04:28 user nova-compute[75453]: WARNING nova.compute.manager [req-04cd1d44-be4e-4096-b9be-4310eb7795d4 req-1ac6a9e1-9923-4dad-bb91-26fbe6490fe1 service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received unexpected event network-vif-plugged-af80811d-0d53-4367-88e4-0a688c183350 for instance with vm_state active and task_state deleting.
Nov 28 14:04:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2e32ccd-05d4-460c-bead-2ffe28f85a30 tempest-ServerActionsV293TestJSON-2097640131 tempest-ServerActionsV293TestJSON-2097640131-project-member] Lock "6466bc94-8a78-4541-a864-9f0370b212c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.590s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:29 user nova-compute[75453]: INFO nova.compute.manager [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Took 0.95 seconds to detach 1 volumes for instance.
Nov 28 14:04:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:29 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:04:29 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:04:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:29 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Deleted allocations for instance 2d3e50a0-3428-42c7-aee0-baa85761b734
Nov 28 14:04:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-962d4b75-97bf-472e-895a-58e9f0ac61c7 tempest-DeleteServersTestJSON-283705446 tempest-DeleteServersTestJSON-283705446-project-member] Lock "2d3e50a0-3428-42c7-aee0-baa85761b734" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.017s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-95061ab5-2b37-4fed-b2dd-a84b1ddf5bdb req-16678c81-51df-458d-902d-a64d93625f09 service nova] [instance: 2d3e50a0-3428-42c7-aee0-baa85761b734] Received event network-vif-deleted-af80811d-0d53-4367-88e4-0a688c183350 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:43 user nova-compute[75453]: DEBUG nova.compute.manager [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received event network-changed-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:43 user nova-compute[75453]: DEBUG nova.compute.manager [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Refreshing instance network info cache due to event network-changed-f0bdc249-748c-4d50-82ce-ad985120d91f. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:04:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] Acquiring lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:04:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] Acquired lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:04:43 user nova-compute[75453]: DEBUG nova.network.neutron [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Refreshing network info cache for port f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:04:44 user nova-compute[75453]: DEBUG nova.network.neutron [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updated VIF entry in instance network info cache for port f0bdc249-748c-4d50-82ce-ad985120d91f. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:04:44 user nova-compute[75453]: DEBUG nova.network.neutron [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updating instance_info_cache with network_info: [{"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:04:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c9e9c9de-d919-4ec2-8283-799d182e8cb4 req-1c549ffa-adf2-448e-b3a0-0a11a8cf8f63 service nova] Releasing lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:04:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing instance network info cache due to event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:04:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] Acquiring lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:04:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] Acquired lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:04:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:04:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updated VIF entry in instance network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:04:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating instance_info_cache with network_info: [{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:04:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-db6f5e85-f928-4a6b-b24e-abb0da32edb7 req-ad2f0cd2-4f09-4579-8f4a-96bc4168574a service nova] Releasing lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:04:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:53 user nova-compute[75453]: INFO nova.compute.manager [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Detaching volume cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:04:53 user nova-compute[75453]: INFO nova.virt.block_device [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Attempting to driver detach volume cb097930-0134-453a-bf8a-a77dbeabc8fa from mountpoint /dev/vdb
Nov 28 14:04:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Attempting to detach device vdb from instance ea32aeb2-975a-4295-aeb6-12e177657219 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:04:53 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:04:53 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:04:53 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:04:53 user nova-compute[75453]:   <serial>cb097930-0134-453a-bf8a-a77dbeabc8fa</serial>
Nov 28 14:04:53 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 14:04:53 user nova-compute[75453]: </disk>
Nov 28 14:04:53 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:04:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Successfully detached device vdb from instance ea32aeb2-975a-4295-aeb6-12e177657219 from the persistent domain config.
Nov 28 14:04:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea32aeb2-975a-4295-aeb6-12e177657219 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:04:53 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:04:53 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:04:53 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:04:53 user nova-compute[75453]:   <serial>cb097930-0134-453a-bf8a-a77dbeabc8fa</serial>
Nov 28 14:04:53 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 14:04:53 user nova-compute[75453]: </disk>
Nov 28 14:04:53 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing instance network info cache due to event network-changed-43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] Acquiring lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] Acquired lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG nova.network.neutron [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Refreshing network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:04:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:04:54 user nova-compute[75453]: DEBUG nova.network.neutron [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updated VIF entry in instance network info cache for port 43357932-6c86-4dd1-9f8b-22adab7793b9. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:04:54 user nova-compute[75453]: DEBUG nova.network.neutron [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating instance_info_cache with network_info: [{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:04:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a43d5fb9-9bd0-4fd2-b38d-e781c6c0602b req-89b750fc-771b-4eb2-866f-8bad2bc41754 service nova] Releasing lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:04:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "3aa772d7-ca30-4a90-b326-3450f9e28784" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "3aa772d7-ca30-4a90-b326-3450f9e28784-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:55 user nova-compute[75453]: INFO nova.compute.manager [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Terminating instance
Nov 28 14:04:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Instance destroyed successfully.
Nov 28 14:04:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'resources' on Instance uuid 3aa772d7-ca30-4a90-b326-3450f9e28784 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1926298954',display_name='tempest-AttachVolumeNegativeTest-server-1926298954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1926298954',id=20,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgIoKRVSV5nMNqKEgIQf0W5MKotAydNA66TSyhlYX6P4EK7Qo0KESqOWiHQOWd4ZAUh5eftROfsJT5+OoKZQ8vCa3ADu1/YgEh40c7+yO222qyd2ZPAI5I1imtXJod6iA==',key_name='tempest-keypair-1356044097',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:02:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-jgomz4a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=3aa772d7-ca30-4a90-b326-3450f9e28784,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "d38482f3-db24-4172-a831-de471ef45c2b", "address": "fa:16:3e:e3:e9:52", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38482f3-db", "ovs_interfaceid": "d38482f3-db24-4172-a831-de471ef45c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e9:52,bridge_name='br-int',has_traffic_filtering=True,id=d38482f3-db24-4172-a831-de471ef45c2b,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38482f3-db') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG os_vif [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e9:52,bridge_name='br-int',has_traffic_filtering=True,id=d38482f3-db24-4172-a831-de471ef45c2b,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38482f3-db') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd38482f3-db, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e28928aa-77e1-4af1-93dc-12fa71c3e93f) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:56 user nova-compute[75453]: INFO os_vif [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e9:52,bridge_name='br-int',has_traffic_filtering=True,id=d38482f3-db24-4172-a831-de471ef45c2b,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38482f3-db')
Nov 28 14:04:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Deleting instance files /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784_del
Nov 28 14:04:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Deletion of /opt/stack/data/nova/instances/3aa772d7-ca30-4a90-b326-3450f9e28784_del complete
Nov 28 14:04:56 user nova-compute[75453]: INFO nova.compute.manager [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 14:04:56 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:04:56 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:04:56 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:04:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:57 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:04:57 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Took 1.65 seconds to deallocate network for instance.
Nov 28 14:04:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-f8a8988a-a8c3-4995-98b5-9b80955d82cc req-f3f34889-7a77-41ec-8dca-0fecd0f567ac service nova] [instance: 3aa772d7-ca30-4a90-b326-3450f9e28784] Received event network-vif-deleted-d38482f3-db24-4172-a831-de471ef45c2b {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:04:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:04:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:04:58 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:04:58 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:04:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:04:58 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Deleted allocations for instance 3aa772d7-ca30-4a90-b326-3450f9e28784
Nov 28 14:04:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:04:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f3dda65e-0a08-48e0-972c-dd2979858714 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "3aa772d7-ca30-4a90-b326-3450f9e28784" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.076s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:05:01 user nova-compute[75453]: INFO nova.compute.claims [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Claim successful on node user
Nov 28 14:05:01 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:05:01 user nova-compute[75453]: DEBUG nova.network.neutron [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:05:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:05:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG nova.policy [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:05:02 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Creating image(s)
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk 1073741824" returned: 0 in 0.067s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG nova.network.neutron [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Successfully created port: d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.213s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Cannot resize image /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Ensure instance console log exists: /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.network.neutron [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Successfully updated port: d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquired lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.network.neutron [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-changed-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Refreshing instance network info cache due to event network-changed-d02ad480-f01f-442a-a00e-7dca16a27d3d. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] Acquiring lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.network.neutron [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.network.neutron [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating instance_info_cache with network_info: [{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Releasing lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance network_info: |[{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] Acquired lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.network.neutron [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Refreshing network info cache for port d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Start _get_guest_xml network_info=[{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:05:03 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:03 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-822996976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-822996976',id=24,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRx1CaHhz7T4iWZHcZU/u7mxv1qFYSTYPVbEd+1AG15eK9htz2w/1zgpgePgXRBe/1I2oHV07JSN71mZsmDsoUxJkz8utVlRxN75p5/8zRBkg+ecBdhPIs3fNz9MW2gDA==',key_name='tempest-keypair-1276374203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-h8fb3xp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:05:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=140e1e3c-a452-44b9-86d3-0e6232512665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.objects.instance [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'pci_devices' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:05:03 user nova-compute[75453]:   <uuid>140e1e3c-a452-44b9-86d3-0e6232512665</uuid>
Nov 28 14:05:03 user nova-compute[75453]:   <name>instance-00000018</name>
Nov 28 14:05:03 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:05:03 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:05:03 user nova-compute[75453]:   <metadata>
Nov 28 14:05:03 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:05:03 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:05:03 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-822996976</nova:name>
Nov 28 14:05:03 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:05:03</nova:creationTime>
Nov 28 14:05:03 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:05:03 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:05:03 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:05:03 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:05:03 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:05:03 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:05:03 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:05:03 user nova-compute[75453]:       <nova:owner>
Nov 28 14:05:03 user nova-compute[75453]:         <nova:user uuid="e8074110936b461690a6518ddee180ac">tempest-AttachVolumeShelveTestJSON-1619345525-project-member</nova:user>
Nov 28 14:05:03 user nova-compute[75453]:         <nova:project uuid="bb60c747fc434b8a8bb9a0df65970d92">tempest-AttachVolumeShelveTestJSON-1619345525</nova:project>
Nov 28 14:05:03 user nova-compute[75453]:       </nova:owner>
Nov 28 14:05:03 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:05:03 user nova-compute[75453]:       <nova:ports>
Nov 28 14:05:03 user nova-compute[75453]:         <nova:port uuid="d02ad480-f01f-442a-a00e-7dca16a27d3d">
Nov 28 14:05:03 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 14:05:03 user nova-compute[75453]:         </nova:port>
Nov 28 14:05:03 user nova-compute[75453]:       </nova:ports>
Nov 28 14:05:03 user nova-compute[75453]:     </nova:instance>
Nov 28 14:05:03 user nova-compute[75453]:   </metadata>
Nov 28 14:05:03 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:05:03 user nova-compute[75453]:     <system>
Nov 28 14:05:03 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:05:03 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:05:03 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:05:03 user nova-compute[75453]:       <entry name="serial">140e1e3c-a452-44b9-86d3-0e6232512665</entry>
Nov 28 14:05:03 user nova-compute[75453]:       <entry name="uuid">140e1e3c-a452-44b9-86d3-0e6232512665</entry>
Nov 28 14:05:03 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:05:03 user nova-compute[75453]:     </system>
Nov 28 14:05:03 user nova-compute[75453]:   </sysinfo>
Nov 28 14:05:03 user nova-compute[75453]:   <os>
Nov 28 14:05:03 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:05:03 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:05:03 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:05:03 user nova-compute[75453]:   </os>
Nov 28 14:05:03 user nova-compute[75453]:   <features>
Nov 28 14:05:03 user nova-compute[75453]:     <acpi/>
Nov 28 14:05:03 user nova-compute[75453]:     <apic/>
Nov 28 14:05:03 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:05:03 user nova-compute[75453]:   </features>
Nov 28 14:05:03 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:05:03 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:05:03 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:05:03 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:05:03 user nova-compute[75453]:   </clock>
Nov 28 14:05:03 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:05:03 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:05:03 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:05:03 user nova-compute[75453]:   </cpu>
Nov 28 14:05:03 user nova-compute[75453]:   <devices>
Nov 28 14:05:03 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:05:03 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:05:03 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk"/>
Nov 28 14:05:03 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:05:03 user nova-compute[75453]:     </disk>
Nov 28 14:05:03 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:05:03 user nova-compute[75453]:       <mac address="fa:16:3e:f4:21:2b"/>
Nov 28 14:05:03 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:05:03 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:05:03 user nova-compute[75453]:       <target dev="tapd02ad480-f0"/>
Nov 28 14:05:03 user nova-compute[75453]:     </interface>
Nov 28 14:05:03 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:05:03 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/console.log" append="off"/>
Nov 28 14:05:03 user nova-compute[75453]:     </serial>
Nov 28 14:05:03 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:05:03 user nova-compute[75453]:     <video>
Nov 28 14:05:03 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:05:03 user nova-compute[75453]:     </video>
Nov 28 14:05:03 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:05:03 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:05:03 user nova-compute[75453]:     </rng>
Nov 28 14:05:03 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:05:03 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:05:03 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:05:03 user nova-compute[75453]:     </memballoon>
Nov 28 14:05:03 user nova-compute[75453]:   </devices>
Nov 28 14:05:03 user nova-compute[75453]: </domain>
Nov 28 14:05:03 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-822996976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-822996976',id=24,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRx1CaHhz7T4iWZHcZU/u7mxv1qFYSTYPVbEd+1AG15eK9htz2w/1zgpgePgXRBe/1I2oHV07JSN71mZsmDsoUxJkz8utVlRxN75p5/8zRBkg+ecBdhPIs3fNz9MW2gDA==',key_name='tempest-keypair-1276374203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-h8fb3xp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:05:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=140e1e3c-a452-44b9-86d3-0e6232512665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG os_vif [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87b24ac1-a83e-52a9-be89-0a0159657f0e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd02ad480-f0, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd02ad480-f0, col_values=(('qos', UUID('86f1c8d9-19ca-4ba1-a710-dd30dc5b8d24')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd02ad480-f0, col_values=(('external_ids', {'iface-id': 'd02ad480-f01f-442a-a00e-7dca16a27d3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:21:2b', 'vm-uuid': '140e1e3c-a452-44b9-86d3-0e6232512665'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:04 user nova-compute[75453]: INFO os_vif [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0')
Nov 28 14:05:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] No VIF found with MAC fa:16:3e:f4:21:2b, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG nova.network.neutron [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updated VIF entry in instance network info cache for port d02ad480-f01f-442a-a00e-7dca16a27d3d. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG nova.network.neutron [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating instance_info_cache with network_info: [{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cf1f5f29-cd0f-495f-95ce-78b4c5547819 req-dc475285-142c-4b63-a69e-ff95bf4f374d service nova] Releasing lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:05:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] No waiting events found dispatching network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:05 user nova-compute[75453]: WARNING nova.compute.manager [req-65a45477-4e61-4114-b73c-9041fcfbc889 req-0ae2fd5b-79ef-4825-9e47-ab9149c4bbc2 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received unexpected event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d for instance with vm_state building and task_state spawning.
Nov 28 14:05:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] No waiting events found dispatching network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:07 user nova-compute[75453]: WARNING nova.compute.manager [req-8aba5dca-78b3-42f7-a26a-626954e4bd16 req-c6585836-168f-4319-9090-9dc87144d6eb service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received unexpected event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d for instance with vm_state building and task_state spawning.
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:05:07 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance spawned successfully.
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:05:07 user nova-compute[75453]: INFO nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 28 14:05:07 user nova-compute[75453]: DEBUG nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:05:08 user nova-compute[75453]: INFO nova.compute.manager [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Took 6.63 seconds to build instance.
Nov 28 14:05:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-dc105d45-50b3-463d-b278-ceeb5dbdcb0b tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.733s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:08 user nova-compute[75453]: INFO nova.compute.manager [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Terminating instance
Nov 28 14:05:08 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:05:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-unplugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-unplugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-48ba946a-0297-4a90-95c7-7ecda5a09c00 req-855d63cb-2c47-40cd-aa7b-5ce50346f43d service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-unplugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:05:09 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Instance destroyed successfully.
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'resources' on Instance uuid 10e135e2-a52b-437c-adb6-3fb81daf17e4 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T13:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1751161168',display_name='tempest-AttachVolumeTestJSON-server-1751161168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1751161168',id=2,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQzKs9c28/I0Jo4yrZ0MxWPtjbD9pMYnHIDrWkBiKT3Krib87cebo6hk9NqLP362uHGtUvxwU0ecaOAO9ZwvcifKMWsKaxcVmJw8YAYLSbRenkRLVMJlUDLdBH0achGWw==',key_name='tempest-keypair-605550184',keypairs=<?>,launch_index=0,launched_at=2023-11-28T13:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-hiprfdzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=10e135e2-a52b-437c-adb6-3fb81daf17e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "address": "fa:16:3e:bd:18:5b", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d8de7f-0f", "ovs_interfaceid": "56d8de7f-0f8a-4f2e-8890-405ec6cb9294", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG os_vif [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56d8de7f-0f, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1633f18-e69a-4912-88b1-ea2c82fcc5d1) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:09 user nova-compute[75453]: INFO os_vif [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:18:5b,bridge_name='br-int',has_traffic_filtering=True,id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d8de7f-0f')
Nov 28 14:05:09 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Deleting instance files /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4_del
Nov 28 14:05:09 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Deletion of /opt/stack/data/nova/instances/10e135e2-a52b-437c-adb6-3fb81daf17e4_del complete
Nov 28 14:05:09 user nova-compute[75453]: INFO nova.compute.manager [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:09 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-deleted-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:10 user nova-compute[75453]: INFO nova.compute.manager [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Neutron deleted interface 56d8de7f-0f8a-4f2e-8890-405ec6cb9294; detaching it from the instance and deleting it from the info cache
Nov 28 14:05:10 user nova-compute[75453]: DEBUG nova.network.neutron [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:10 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Took 0.95 seconds to deallocate network for instance.
Nov 28 14:05:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-d12a797f-83a4-4bda-af8f-0fa7c3b19f3c req-19180a8f-b11a-40ff-809a-ec5c856d336d service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Detach interface failed, port_id=56d8de7f-0f8a-4f2e-8890-405ec6cb9294, reason: Instance 10e135e2-a52b-437c-adb6-3fb81daf17e4 could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:10 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid '10e135e2-a52b-437c-adb6-3fb81daf17e4' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid '10e135e2-a52b-437c-adb6-3fb81daf17e4' (instance-00000002)
Nov 28 14:05:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:05:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:11 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Deleted allocations for instance 10e135e2-a52b-437c-adb6-3fb81daf17e4
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f8a08f05-6aa0-4fd8-8759-80f48b7d883b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] Acquiring lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] Lock "10e135e2-a52b-437c-adb6-3fb81daf17e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] No waiting events found dispatching network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:11 user nova-compute[75453]: WARNING nova.compute.manager [req-4e793f55-8400-4fbf-ba87-a5ae73212059 req-ae31ca5e-1e48-4d1a-9121-e10c444e510b service nova] [instance: 10e135e2-a52b-437c-adb6-3fb81daf17e4] Received unexpected event network-vif-plugged-56d8de7f-0f8a-4f2e-8890-405ec6cb9294 for instance with vm_state deleted and task_state None.
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:11 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:11 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:11 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8324MB free_disk=25.427913665771484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance ea32aeb2-975a-4295-aeb6-12e177657219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 140e1e3c-a452-44b9-86d3-0e6232512665 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:05:11 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:05:12 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:05:12 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:05:12 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:05:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:05:13 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ea32aeb2-975a-4295-aeb6-12e177657219 is timed out.
Nov 28 14:05:13 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Successfully detached device vdb from instance ea32aeb2-975a-4295-aeb6-12e177657219 from the live domain config.
Nov 28 14:05:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftPdySXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:05:13 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a091af9-da1b-41a3-b147-da2234d03e7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:05:13 user nova-compute[75453]: No targets found.
Nov 28 14:05:13 user nova-compute[75453]: iSNS:
Nov 28 14:05:13 user nova-compute[75453]: No targets found.
Nov 28 14:05:13 user nova-compute[75453]: STATIC:
Nov 28 14:05:13 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa
Nov 28 14:05:13 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:05:13 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:05:13 user nova-compute[75453]: FIRMWARE:
Nov 28 14:05:13 user nova-compute[75453]: No targets found.
Nov 28 14:05:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:05:13 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:05:13 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1766b61-8dc8-445d-a52c-8d2a953a8700]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7d260c-0774-4e98-b17b-5696d7b56f6f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:05:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa (non-flash)
Nov 28 14:05:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c26ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating instance_info_cache with network_info: [{"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9e0304-1775-4678-baf1-24fefd3d0ce8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-ea32aeb2-975a-4295-aeb6-12e177657219" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebde9821-5960-47ed-b990-0e93d5927a95]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[012b912c-9e69-4eb3-9d19-6184741c56ad]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:05:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[073e4c6d-2141-4ff2-abb0-b9966357867f]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd24dbb-b291-478d-9b30-ab27beeba3e2]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bebc82c-c91a-4731-b943-b10caabd74bf]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260]
Nov 28 14:05:14 user nova-compute[75453]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa, portal: 172.16.0.220,3260] successful.
Nov 28 14:05:14 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb097930-0134-453a-bf8a-a77dbeabc8fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe8312-a57e-4a6e-b649-42c1df89808e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] <== disconnect_volume: return (295ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:14 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'flavor' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ecebee57-8e00-42e7-affb-c1eefc035ae7 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.952s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:05:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:23 user nova-compute[75453]: INFO nova.compute.manager [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Unshelving
Nov 28 14:05:23 user nova-compute[75453]: INFO nova.virt.block_device [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Booting with volume f30f0930-b3ec-4e8d-99ae-cd205eb43c59 at /dev/vda
Nov 28 14:05:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG os_brick.utils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ede5015-2888-45f9-90f3-54ad8fa81916]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5724e131-014d-412b-b424-1f09a851a244]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dd25a5-b617-42ac-ac2a-f56f832f2af4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd008f19-1d22-4ee9-81ca-d66f5f9b8a39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:05:23 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:05:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed555580-8303-487b-9c90-bd2873192f44]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG os_brick.utils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:05:23 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating existing volume attachment record: 89cac16e-d8a4-4be2-99c2-a3526fc4afb6 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:05:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:31 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lazy-loading 'pci_requests' on Instance uuid 807c145e-9d41-4a76-8777-c033276ba96a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:31 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lazy-loading 'numa_topology' on Instance uuid 807c145e-9d41-4a76-8777-c033276ba96a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:05:31 user nova-compute[75453]: INFO nova.compute.claims [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Claim successful on node user
Nov 28 14:05:31 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:05:31 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:05:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:31 user nova-compute[75453]: INFO nova.network.neutron [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating port 36fe7f7b-64c5-47bd-815b-b61516ad2167 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 14:05:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:05:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquired lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:05:32 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing instance network info cache due to event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] Acquiring lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Releasing lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:05:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Creating image(s)
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Ensure instance console log exists: /opt/stack/data/nova/instances/807c145e-9d41-4a76-8777-c033276ba96a/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Start _get_guest_xml network_info=[{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '89cac16e-d8a4-4be2-99c2-a3526fc4afb6', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPxhjlQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '807c145e-9d41-4a76-8777-c033276ba96a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'serial': 'f30f0930-b3ec-4e8d-99ae-cd205eb43c59'}, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] Acquired lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.network.neutron [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:05:33 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:33 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lazy-loading 'vcpu_model' on Instance uuid 807c145e-9d41-4a76-8777-c033276ba96a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.objects.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Object Instance<807c145e-9d41-4a76-8777-c033276ba96a> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPxhjlQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:05:33 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:05:33 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:05:33 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[263dbea2-6d4d-487b-89a8-35c438eb93f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:05:33 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a3d753-54a9-4b6c-b8d9-57db1168721f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59] added
Nov 28 14:05:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f3ff30-3de4-4f1c-98a5-97a4450b2191]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f657ad-de3c-46b5-8ca7-67b9eb2c5e49]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPxhjlQX {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPxhjlQX" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c492d4-e244-4473-9202-a2950839d168]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RPxhjlQX'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8aa30a-f498-4730-904a-8eae6dcfc24c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[325b3d74-c263-4638-916f-3d04a8f8b4ee]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:05:33 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:05:33 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:05:33 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:05:33 user nova-compute[75453]: 
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[717e5291-97ed-4761-b975-987e0f8d6d6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260]
Nov 28 14:05:33 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260] successful.
Nov 28 14:05:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7972ed-f2d8-43a1-b700-9b98a3fd83f9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5adc9f-61bf-4c82-9262-f74d372ef72d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:05:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:05:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1101b222-bbec-4d14-8f6b-b6bde9f5a862]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:05:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.network.neutron [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updated VIF entry in instance network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.network.neutron [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ff240c4c-e357-4f7c-a7ab-1e7c0cff781a req-478b303e-c670-40bd-8504-00d53b104b1b service nova] Releasing lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPxhjlQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23861303463623234', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861303463623234', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023395681',display_name='tempest-TestShelveInstance-server-1023395681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023395681',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1470109784',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:01:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d5606d16b2f44aa0a189a0b20d687cbc',ramdisk_id='',reservation_id='r-00jaku0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-511272115',owner_user_name='tempest-TestShelveInstance-511272115-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:05:23Z,user_data=None,user_id='6f9c41c5c12e4ce0b5848dc319ceff1d',uuid=807c145e-9d41-4a76-8777-c033276ba96a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converting VIF {"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lazy-loading 'pci_devices' on Instance uuid 807c145e-9d41-4a76-8777-c033276ba96a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.objects.base [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Object Instance<807c145e-9d41-4a76-8777-c033276ba96a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:05:34 user nova-compute[75453]:   <uuid>807c145e-9d41-4a76-8777-c033276ba96a</uuid>
Nov 28 14:05:34 user nova-compute[75453]:   <name>instance-00000013</name>
Nov 28 14:05:34 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:05:34 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:05:34 user nova-compute[75453]:   <metadata>
Nov 28 14:05:34 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:05:34 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:05:34 user nova-compute[75453]:       <nova:name>tempest-TestShelveInstance-server-1023395681</nova:name>
Nov 28 14:05:34 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:05:33</nova:creationTime>
Nov 28 14:05:34 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:05:34 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:05:34 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:05:34 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:05:34 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:05:34 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:05:34 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:05:34 user nova-compute[75453]:       <nova:owner>
Nov 28 14:05:34 user nova-compute[75453]:         <nova:user uuid="6f9c41c5c12e4ce0b5848dc319ceff1d">tempest-TestShelveInstance-511272115-project-member</nova:user>
Nov 28 14:05:34 user nova-compute[75453]:         <nova:project uuid="d5606d16b2f44aa0a189a0b20d687cbc">tempest-TestShelveInstance-511272115</nova:project>
Nov 28 14:05:34 user nova-compute[75453]:       </nova:owner>
Nov 28 14:05:34 user nova-compute[75453]:       <nova:ports>
Nov 28 14:05:34 user nova-compute[75453]:         <nova:port uuid="36fe7f7b-64c5-47bd-815b-b61516ad2167">
Nov 28 14:05:34 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 14:05:34 user nova-compute[75453]:         </nova:port>
Nov 28 14:05:34 user nova-compute[75453]:       </nova:ports>
Nov 28 14:05:34 user nova-compute[75453]:     </nova:instance>
Nov 28 14:05:34 user nova-compute[75453]:   </metadata>
Nov 28 14:05:34 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:05:34 user nova-compute[75453]:     <system>
Nov 28 14:05:34 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:05:34 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:05:34 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:05:34 user nova-compute[75453]:       <entry name="serial">807c145e-9d41-4a76-8777-c033276ba96a</entry>
Nov 28 14:05:34 user nova-compute[75453]:       <entry name="uuid">807c145e-9d41-4a76-8777-c033276ba96a</entry>
Nov 28 14:05:34 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:05:34 user nova-compute[75453]:     </system>
Nov 28 14:05:34 user nova-compute[75453]:   </sysinfo>
Nov 28 14:05:34 user nova-compute[75453]:   <os>
Nov 28 14:05:34 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:05:34 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:05:34 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:05:34 user nova-compute[75453]:   </os>
Nov 28 14:05:34 user nova-compute[75453]:   <features>
Nov 28 14:05:34 user nova-compute[75453]:     <acpi/>
Nov 28 14:05:34 user nova-compute[75453]:     <apic/>
Nov 28 14:05:34 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:05:34 user nova-compute[75453]:   </features>
Nov 28 14:05:34 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:05:34 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:05:34 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:05:34 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:05:34 user nova-compute[75453]:   </clock>
Nov 28 14:05:34 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:05:34 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:05:34 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:05:34 user nova-compute[75453]:   </cpu>
Nov 28 14:05:34 user nova-compute[75453]:   <devices>
Nov 28 14:05:34 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:05:34 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:05:34 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:05:34 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:05:34 user nova-compute[75453]:       <serial>f30f0930-b3ec-4e8d-99ae-cd205eb43c59</serial>
Nov 28 14:05:34 user nova-compute[75453]:     </disk>
Nov 28 14:05:34 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:05:34 user nova-compute[75453]:       <mac address="fa:16:3e:36:e4:41"/>
Nov 28 14:05:34 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:05:34 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:05:34 user nova-compute[75453]:       <target dev="tap36fe7f7b-64"/>
Nov 28 14:05:34 user nova-compute[75453]:     </interface>
Nov 28 14:05:34 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:05:34 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/807c145e-9d41-4a76-8777-c033276ba96a/console.log" append="off"/>
Nov 28 14:05:34 user nova-compute[75453]:     </serial>
Nov 28 14:05:34 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:05:34 user nova-compute[75453]:     <video>
Nov 28 14:05:34 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:05:34 user nova-compute[75453]:     </video>
Nov 28 14:05:34 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:05:34 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:05:34 user nova-compute[75453]:     </rng>
Nov 28 14:05:34 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:05:34 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:05:34 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:05:34 user nova-compute[75453]:     </memballoon>
Nov 28 14:05:34 user nova-compute[75453]:   </devices>
Nov 28 14:05:34 user nova-compute[75453]: </domain>
Nov 28 14:05:34 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023395681',display_name='tempest-TestShelveInstance-server-1023395681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023395681',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1470109784',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:01:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d5606d16b2f44aa0a189a0b20d687cbc',ramdisk_id='',reservation_id='r-00jaku0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-511272115',owner_user_name='tempest-TestShelveInstance-511272115-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:05:23Z,user_data=None,user_id='6f9c41c5c12e4ce0b5848dc319ceff1d',uuid=807c145e-9d41-4a76-8777-c033276ba96a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converting VIF {"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG os_vif [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ed80408-002c-52e2-9fbd-5e4f18642f35', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36fe7f7b-64, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36fe7f7b-64, col_values=(('qos', UUID('1c37ec18-d1f7-494a-a150-76476267ed78')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36fe7f7b-64, col_values=(('external_ids', {'iface-id': '36fe7f7b-64c5-47bd-815b-b61516ad2167', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:e4:41', 'vm-uuid': '807c145e-9d41-4a76-8777-c033276ba96a'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:35 user nova-compute[75453]: INFO os_vif [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64')
Nov 28 14:05:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:05:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] No VIF found with MAC fa:16:3e:36:e4:41, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:05:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] No waiting events found dispatching network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:36 user nova-compute[75453]: WARNING nova.compute.manager [req-d1b37867-41c6-44c2-9752-d6ed7e521fb0 req-df404ae8-d44a-49fc-8afb-6cc694e8e2b3 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received unexpected event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 14:05:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:05:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:05:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Instance spawned successfully.
Nov 28 14:05:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:05:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d35b5e5c-be24-4e88-b4be-2d2cc0b27141 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.610s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] No waiting events found dispatching network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:38 user nova-compute[75453]: WARNING nova.compute.manager [req-113a9258-d00d-4a09-b6ec-f2d55d4809f8 req-19b7502f-acf4-4ffa-b6bb-dd7dcd3bc4f6 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received unexpected event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance with vm_state active and task_state None.
Nov 28 14:05:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:48 user nova-compute[75453]: INFO nova.compute.manager [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Terminating instance
Nov 28 14:05:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-unplugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] No waiting events found dispatching network-vif-unplugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-ccce6af0-7f60-4b0c-bcbd-d2cacd712ecc req-dc017a4d-7f50-44ae-964d-b268495e81f9 service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-unplugged-43357932-6c86-4dd1-9f8b-22adab7793b9 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:05:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Instance destroyed successfully.
Nov 28 14:05:49 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'resources' on Instance uuid ea32aeb2-975a-4295-aeb6-12e177657219 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1236309658',display_name='tempest-TestMinimumBasicScenario-server-1236309658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1236309658',id=16,image_ref='13624d8f-7316-4efc-8993-8da1904872d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYvCKgE/uykfhOgOg6D3nUJ6Umd15sNMuRUU7xu8xWn0qGR9/rUAbuCSIg8mpk+H8TVnl8JQxOpUjgQJBLfW2bLKjH0SnWK8Q02tRGF2ZPKxSiZhErFGWHG+pBmFqIquw==',key_name='tempest-TestMinimumBasicScenario-423384039',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:00:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4056ca714ed4e85878d7819ef63b20c',ramdisk_id='',reservation_id='r-stm222as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13624d8f-7316-4efc-8993-8da1904872d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2080131890',owner_user_name='tempest-TestMinimumBasicScenario-2080131890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:03:07Z,user_data=None,user_id='e109047aa8a34d8aad03c6c0dc14c7c8',uuid=ea32aeb2-975a-4295-aeb6-12e177657219,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converting VIF {"id": "43357932-6c86-4dd1-9f8b-22adab7793b9", "address": "fa:16:3e:a1:ed:0c", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43357932-6c", "ovs_interfaceid": "43357932-6c86-4dd1-9f8b-22adab7793b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG os_vif [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43357932-6c, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03603bbb-2c45-4d33-b222-2f6b0ec0422a) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:49 user nova-compute[75453]: INFO os_vif [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ed:0c,bridge_name='br-int',has_traffic_filtering=True,id=43357932-6c86-4dd1-9f8b-22adab7793b9,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43357932-6c')
Nov 28 14:05:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Deleting instance files /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219_del
Nov 28 14:05:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Deletion of /opt/stack/data/nova/instances/ea32aeb2-975a-4295-aeb6-12e177657219_del complete
Nov 28 14:05:49 user nova-compute[75453]: INFO nova.compute.manager [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 28 14:05:49 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:05:49 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:05:50 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:50 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Took 0.86 seconds to deallocate network for instance.
Nov 28 14:05:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:50 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:05:50 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:05:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:50 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Deleted allocations for instance ea32aeb2-975a-4295-aeb6-12e177657219
Nov 28 14:05:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "93312f50-72e0-4d65-a125-e6101ad73c91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "93312f50-72e0-4d65-a125-e6101ad73c91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c36dd76d-e63e-4b7b-aef0-b164b2dc5cb5 tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "ea32aeb2-975a-4295-aeb6-12e177657219" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:05:51 user nova-compute[75453]: INFO nova.compute.claims [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Claim successful on node user
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] Acquiring lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] Lock "ea32aeb2-975a-4295-aeb6-12e177657219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] No waiting events found dispatching network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:51 user nova-compute[75453]: WARNING nova.compute.manager [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received unexpected event network-vif-plugged-43357932-6c86-4dd1-9f8b-22adab7793b9 for instance with vm_state deleted and task_state None.
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-2154be15-3d70-4bbd-98fb-421cf3ae5f05 req-b557e72e-6dd6-4597-8ec8-ac44724171fe service nova] [instance: ea32aeb2-975a-4295-aeb6-12e177657219] Received event network-vif-deleted-43357932-6c86-4dd1-9f8b-22adab7793b9 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:51 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.policy [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02461b60e13a4db999369d87c2e426e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e6f2f181214fa494ee8b5ca7eaad86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:05:51 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Creating image(s)
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "/opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "/opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "/opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:51 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:05:51 user nova-compute[75453]: INFO nova.compute.claims [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Claim successful on node user
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.221s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk 1073741824" returned: 0 in 0.052s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Successfully created port: ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.198s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.network.neutron [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:05:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.policy [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2afdefdd832241779d405f4763c3b37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b710669f2d5c41378e2c63765f2846ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Cannot resize image /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Ensure instance console log exists: /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:05:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Creating image(s)
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "/opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "/opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk 1073741824" returned: 0 in 0.047s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.network.neutron [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Successfully created port: 26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.210s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Successfully updated port: ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "refresh_cache-93312f50-72e0-4d65-a125-e6101ad73c91" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquired lock "refresh_cache-93312f50-72e0-4d65-a125-e6101ad73c91" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received event network-changed-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Refreshing instance network info cache due to event network-changed-ead8790b-5e34-4c7d-a8af-a4a121fd03ac. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] Acquiring lock "refresh_cache-93312f50-72e0-4d65-a125-e6101ad73c91" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Cannot resize image /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Ensure instance console log exists: /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Updating instance_info_cache with network_info: [{"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Releasing lock "refresh_cache-93312f50-72e0-4d65-a125-e6101ad73c91" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Instance network_info: |[{"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] Acquired lock "refresh_cache-93312f50-72e0-4d65-a125-e6101ad73c91" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.network.neutron [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Refreshing network info cache for port ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Start _get_guest_xml network_info=[{"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:05:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:05:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-732089374',display_name='tempest-VolumesActionsTest-instance-732089374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-732089374',id=25,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70e6f2f181214fa494ee8b5ca7eaad86',ramdisk_id='',reservation_id='r-vpym5845',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-59909644',owner_user_name='tempest-VolumesActionsTest-59909644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:05:52Z,user_data=None,user_id='02461b60e13a4db999369d87c2e426e8',uuid=93312f50-72e0-4d65-a125-e6101ad73c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Converting VIF {"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cf:70,bridge_name='br-int',has_traffic_filtering=True,id=ead8790b-5e34-4c7d-a8af-a4a121fd03ac,network=Network(6ab99829-a69e-4d03-a12d-572a7d42564a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapead8790b-5e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.objects.instance [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lazy-loading 'pci_devices' on Instance uuid 93312f50-72e0-4d65-a125-e6101ad73c91 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:05:54 user nova-compute[75453]:   <uuid>93312f50-72e0-4d65-a125-e6101ad73c91</uuid>
Nov 28 14:05:54 user nova-compute[75453]:   <name>instance-00000019</name>
Nov 28 14:05:54 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:05:54 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:05:54 user nova-compute[75453]:   <metadata>
Nov 28 14:05:54 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:05:54 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:name>tempest-VolumesActionsTest-instance-732089374</nova:name>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:05:53</nova:creationTime>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:05:54 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:05:54 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:owner>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:user uuid="02461b60e13a4db999369d87c2e426e8">tempest-VolumesActionsTest-59909644-project-member</nova:user>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:project uuid="70e6f2f181214fa494ee8b5ca7eaad86">tempest-VolumesActionsTest-59909644</nova:project>
Nov 28 14:05:54 user nova-compute[75453]:       </nova:owner>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:ports>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:port uuid="ead8790b-5e34-4c7d-a8af-a4a121fd03ac">
Nov 28 14:05:54 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 14:05:54 user nova-compute[75453]:         </nova:port>
Nov 28 14:05:54 user nova-compute[75453]:       </nova:ports>
Nov 28 14:05:54 user nova-compute[75453]:     </nova:instance>
Nov 28 14:05:54 user nova-compute[75453]:   </metadata>
Nov 28 14:05:54 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:05:54 user nova-compute[75453]:     <system>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="serial">93312f50-72e0-4d65-a125-e6101ad73c91</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="uuid">93312f50-72e0-4d65-a125-e6101ad73c91</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:05:54 user nova-compute[75453]:     </system>
Nov 28 14:05:54 user nova-compute[75453]:   </sysinfo>
Nov 28 14:05:54 user nova-compute[75453]:   <os>
Nov 28 14:05:54 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:05:54 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:05:54 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:05:54 user nova-compute[75453]:   </os>
Nov 28 14:05:54 user nova-compute[75453]:   <features>
Nov 28 14:05:54 user nova-compute[75453]:     <acpi/>
Nov 28 14:05:54 user nova-compute[75453]:     <apic/>
Nov 28 14:05:54 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:05:54 user nova-compute[75453]:   </features>
Nov 28 14:05:54 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:05:54 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:05:54 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:05:54 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:05:54 user nova-compute[75453]:   </clock>
Nov 28 14:05:54 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:05:54 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:05:54 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:05:54 user nova-compute[75453]:   </cpu>
Nov 28 14:05:54 user nova-compute[75453]:   <devices>
Nov 28 14:05:54 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:05:54 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:05:54 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk"/>
Nov 28 14:05:54 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:05:54 user nova-compute[75453]:     </disk>
Nov 28 14:05:54 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:05:54 user nova-compute[75453]:       <mac address="fa:16:3e:8c:cf:70"/>
Nov 28 14:05:54 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:05:54 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:05:54 user nova-compute[75453]:       <target dev="tapead8790b-5e"/>
Nov 28 14:05:54 user nova-compute[75453]:     </interface>
Nov 28 14:05:54 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:05:54 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/console.log" append="off"/>
Nov 28 14:05:54 user nova-compute[75453]:     </serial>
Nov 28 14:05:54 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:05:54 user nova-compute[75453]:     <video>
Nov 28 14:05:54 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:05:54 user nova-compute[75453]:     </video>
Nov 28 14:05:54 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:05:54 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:05:54 user nova-compute[75453]:     </rng>
Nov 28 14:05:54 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:05:54 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:05:54 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:05:54 user nova-compute[75453]:     </memballoon>
Nov 28 14:05:54 user nova-compute[75453]:   </devices>
Nov 28 14:05:54 user nova-compute[75453]: </domain>
Nov 28 14:05:54 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-732089374',display_name='tempest-VolumesActionsTest-instance-732089374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-732089374',id=25,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70e6f2f181214fa494ee8b5ca7eaad86',ramdisk_id='',reservation_id='r-vpym5845',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-59909644',owner_user_name='tempest-VolumesActionsTest-59909644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:05:52Z,user_data=None,user_id='02461b60e13a4db999369d87c2e426e8',uuid=93312f50-72e0-4d65-a125-e6101ad73c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Converting VIF {"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cf:70,bridge_name='br-int',has_traffic_filtering=True,id=ead8790b-5e34-4c7d-a8af-a4a121fd03ac,network=Network(6ab99829-a69e-4d03-a12d-572a7d42564a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapead8790b-5e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG os_vif [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cf:70,bridge_name='br-int',has_traffic_filtering=True,id=ead8790b-5e34-4c7d-a8af-a4a121fd03ac,network=Network(6ab99829-a69e-4d03-a12d-572a7d42564a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapead8790b-5e') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b30f9f6-ec93-5de0-8ba1-4ceef60e0360', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapead8790b-5e, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapead8790b-5e, col_values=(('qos', UUID('437a8bd2-1a1d-415a-85cb-b439477df7cd')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapead8790b-5e, col_values=(('external_ids', {'iface-id': 'ead8790b-5e34-4c7d-a8af-a4a121fd03ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:cf:70', 'vm-uuid': '93312f50-72e0-4d65-a125-e6101ad73c91'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: INFO os_vif [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cf:70,bridge_name='br-int',has_traffic_filtering=True,id=ead8790b-5e34-4c7d-a8af-a4a121fd03ac,network=Network(6ab99829-a69e-4d03-a12d-572a7d42564a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapead8790b-5e')
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] No VIF found with MAC fa:16:3e:8c:cf:70, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.neutron [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Successfully updated port: 26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "refresh_cache-2c994fe4-2ec9-497f-9069-1fbbfafa3410" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquired lock "refresh_cache-2c994fe4-2ec9-497f-9069-1fbbfafa3410" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.neutron [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.neutron [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.neutron [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Updated VIF entry in instance network info cache for port ead8790b-5e34-4c7d-a8af-a4a121fd03ac. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.neutron [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Updating instance_info_cache with network_info: [{"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5d22de87-5dbd-475c-9111-8e9b8aa5fb49 req-38d927e1-84a1-4bd9-b957-0a6b85f0540d service nova] Releasing lock "refresh_cache-93312f50-72e0-4d65-a125-e6101ad73c91" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received event network-changed-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Refreshing instance network info cache due to event network-changed-26578bc1-9515-4ec1-a156-a2a6de8681cf. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] Acquiring lock "refresh_cache-2c994fe4-2ec9-497f-9069-1fbbfafa3410" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.neutron [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Updating instance_info_cache with network_info: [{"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Releasing lock "refresh_cache-2c994fe4-2ec9-497f-9069-1fbbfafa3410" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Instance network_info: |[{"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] Acquired lock "refresh_cache-2c994fe4-2ec9-497f-9069-1fbbfafa3410" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.neutron [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Refreshing network info cache for port 26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Start _get_guest_xml network_info=[{"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:05:54 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:54 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1001588883',display_name='tempest-AttachVolumeNegativeTest-server-1001588883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1001588883',id=26,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXDMolo6w7qSOXv1l6Avbf9K2hLPR2zVqVxwo4QijsQzb2s+d8Sb/i5JGKrR68loytXMx+JqlFbWuJ3sNpIxhX0BWXkTOmK/gfwSkeBfCHv9PyJdB1VxE/hnfjZJS8v0Q==',key_name='tempest-keypair-464159864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-90n7990m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=2c994fe4-2ec9-497f-9069-1fbbfafa3410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:bd:48,bridge_name='br-int',has_traffic_filtering=True,id=26578bc1-9515-4ec1-a156-a2a6de8681cf,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26578bc1-95') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.objects.instance [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c994fe4-2ec9-497f-9069-1fbbfafa3410 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:05:54 user nova-compute[75453]:   <uuid>2c994fe4-2ec9-497f-9069-1fbbfafa3410</uuid>
Nov 28 14:05:54 user nova-compute[75453]:   <name>instance-0000001a</name>
Nov 28 14:05:54 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:05:54 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:05:54 user nova-compute[75453]:   <metadata>
Nov 28 14:05:54 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:05:54 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1001588883</nova:name>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:05:54</nova:creationTime>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:05:54 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:05:54 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:owner>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:user uuid="2afdefdd832241779d405f4763c3b37e">tempest-AttachVolumeNegativeTest-180653455-project-member</nova:user>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:project uuid="b710669f2d5c41378e2c63765f2846ed">tempest-AttachVolumeNegativeTest-180653455</nova:project>
Nov 28 14:05:54 user nova-compute[75453]:       </nova:owner>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:05:54 user nova-compute[75453]:       <nova:ports>
Nov 28 14:05:54 user nova-compute[75453]:         <nova:port uuid="26578bc1-9515-4ec1-a156-a2a6de8681cf">
Nov 28 14:05:54 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 14:05:54 user nova-compute[75453]:         </nova:port>
Nov 28 14:05:54 user nova-compute[75453]:       </nova:ports>
Nov 28 14:05:54 user nova-compute[75453]:     </nova:instance>
Nov 28 14:05:54 user nova-compute[75453]:   </metadata>
Nov 28 14:05:54 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:05:54 user nova-compute[75453]:     <system>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="serial">2c994fe4-2ec9-497f-9069-1fbbfafa3410</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="uuid">2c994fe4-2ec9-497f-9069-1fbbfafa3410</entry>
Nov 28 14:05:54 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:05:54 user nova-compute[75453]:     </system>
Nov 28 14:05:54 user nova-compute[75453]:   </sysinfo>
Nov 28 14:05:54 user nova-compute[75453]:   <os>
Nov 28 14:05:54 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:05:54 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:05:54 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:05:54 user nova-compute[75453]:   </os>
Nov 28 14:05:54 user nova-compute[75453]:   <features>
Nov 28 14:05:54 user nova-compute[75453]:     <acpi/>
Nov 28 14:05:54 user nova-compute[75453]:     <apic/>
Nov 28 14:05:54 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:05:54 user nova-compute[75453]:   </features>
Nov 28 14:05:54 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:05:54 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:05:54 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:05:54 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:05:54 user nova-compute[75453]:   </clock>
Nov 28 14:05:54 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:05:54 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:05:54 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:05:54 user nova-compute[75453]:   </cpu>
Nov 28 14:05:54 user nova-compute[75453]:   <devices>
Nov 28 14:05:54 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:05:54 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:05:54 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk"/>
Nov 28 14:05:54 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:05:54 user nova-compute[75453]:     </disk>
Nov 28 14:05:54 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:05:54 user nova-compute[75453]:       <mac address="fa:16:3e:b9:bd:48"/>
Nov 28 14:05:54 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:05:54 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:05:54 user nova-compute[75453]:       <target dev="tap26578bc1-95"/>
Nov 28 14:05:54 user nova-compute[75453]:     </interface>
Nov 28 14:05:54 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:05:54 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/console.log" append="off"/>
Nov 28 14:05:54 user nova-compute[75453]:     </serial>
Nov 28 14:05:54 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:05:54 user nova-compute[75453]:     <video>
Nov 28 14:05:54 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:05:54 user nova-compute[75453]:     </video>
Nov 28 14:05:54 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:05:54 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:05:54 user nova-compute[75453]:     </rng>
Nov 28 14:05:54 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:05:54 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:05:54 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:05:54 user nova-compute[75453]:     </memballoon>
Nov 28 14:05:54 user nova-compute[75453]:   </devices>
Nov 28 14:05:54 user nova-compute[75453]: </domain>
Nov 28 14:05:54 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1001588883',display_name='tempest-AttachVolumeNegativeTest-server-1001588883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1001588883',id=26,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXDMolo6w7qSOXv1l6Avbf9K2hLPR2zVqVxwo4QijsQzb2s+d8Sb/i5JGKrR68loytXMx+JqlFbWuJ3sNpIxhX0BWXkTOmK/gfwSkeBfCHv9PyJdB1VxE/hnfjZJS8v0Q==',key_name='tempest-keypair-464159864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-90n7990m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=2c994fe4-2ec9-497f-9069-1fbbfafa3410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:bd:48,bridge_name='br-int',has_traffic_filtering=True,id=26578bc1-9515-4ec1-a156-a2a6de8681cf,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26578bc1-95') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG os_vif [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:bd:48,bridge_name='br-int',has_traffic_filtering=True,id=26578bc1-9515-4ec1-a156-a2a6de8681cf,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26578bc1-95') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbcacd50-0755-5d72-98b4-b504832e47dd', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26578bc1-95, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26578bc1-95, col_values=(('qos', UUID('8441579f-688b-4e44-b8cd-f670358332b4')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26578bc1-95, col_values=(('external_ids', {'iface-id': '26578bc1-9515-4ec1-a156-a2a6de8681cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:bd:48', 'vm-uuid': '2c994fe4-2ec9-497f-9069-1fbbfafa3410'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:54 user nova-compute[75453]: INFO os_vif [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:bd:48,bridge_name='br-int',has_traffic_filtering=True,id=26578bc1-9515-4ec1-a156-a2a6de8681cf,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26578bc1-95')
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:05:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No VIF found with MAC fa:16:3e:b9:bd:48, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:05:54 user nova-compute[75453]: INFO nova.compute.manager [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] instance snapshotting
Nov 28 14:05:55 user nova-compute[75453]: DEBUG nova.network.neutron [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Updated VIF entry in instance network info cache for port 26578bc1-9515-4ec1-a156-a2a6de8681cf. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:05:55 user nova-compute[75453]: DEBUG nova.network.neutron [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Updating instance_info_cache with network_info: [{"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:05:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ca0241cb-6553-4d67-b6eb-212fb23cb0f9 req-b6f3946d-bf66-4e51-b040-b75237a0efa5 service nova] Releasing lock "refresh_cache-2c994fe4-2ec9-497f-9069-1fbbfafa3410" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:05:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Beginning live snapshot process
Nov 28 14:05:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json -f qcow2 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json -f qcow2 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeiw0seat/77e7727c578b4fa0897a0fcea5b2ef27.delta 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeiw0seat/77e7727c578b4fa0897a0fcea5b2ef27.delta 1073741824" returned: 0 in 0.055s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 14:05:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] COPY block job progress, current cursor: 21102592 final cursor: 75497472 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received event network-vif-plugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] Acquiring lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] No waiting events found dispatching network-vif-plugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:57 user nova-compute[75453]: WARNING nova.compute.manager [req-a09584a2-d6c2-47ff-989a-961350998eb8 req-0ecc09b1-df72-4539-a266-29cae7d7a9a6 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received unexpected event network-vif-plugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance with vm_state building and task_state spawning.
Nov 28 14:05:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received event network-vif-plugged-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] No waiting events found dispatching network-vif-plugged-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:57 user nova-compute[75453]: WARNING nova.compute.manager [req-1d201a6e-3eb8-470d-bc53-ae9b7845f4b6 req-d46c8059-9ba5-4dcd-8d0d-4655601608ac service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received unexpected event network-vif-plugged-26578bc1-9515-4ec1-a156-a2a6de8681cf for instance with vm_state building and task_state spawning.
Nov 28 14:05:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 14:05:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 14:05:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:58 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:05:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeiw0seat/77e7727c578b4fa0897a0fcea5b2ef27.delta /opt/stack/data/nova/instances/snapshots/tmpeiw0seat/77e7727c578b4fa0897a0fcea5b2ef27 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:05:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeiw0seat/77e7727c578b4fa0897a0fcea5b2ef27.delta /opt/stack/data/nova/instances/snapshots/tmpeiw0seat/77e7727c578b4fa0897a0fcea5b2ef27" returned: 0 in 0.637s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:05:58 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Snapshot extracted, beginning image upload
Nov 28 14:05:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received event network-vif-plugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] Acquiring lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] No waiting events found dispatching network-vif-plugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:59 user nova-compute[75453]: WARNING nova.compute.manager [req-aae0dc18-94f6-4af4-9b53-a69e62c0fecc req-45b6e3c5-f4aa-402b-9d7a-581e57197983 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received unexpected event network-vif-plugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance with vm_state building and task_state spawning.
Nov 28 14:05:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received event network-vif-plugged-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:05:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] No waiting events found dispatching network-vif-plugged-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:05:59 user nova-compute[75453]: WARNING nova.compute.manager [req-cd6fc37c-5d32-45e2-a99e-0f6d2bde81cc req-555d8cc1-99fa-47c7-9246-a890d3f3d368 service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received unexpected event network-vif-plugged-26578bc1-9515-4ec1-a156-a2a6de8681cf for instance with vm_state building and task_state spawning.
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:06:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Instance spawned successfully.
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Instance spawned successfully.
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:00 user nova-compute[75453]: INFO nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Took 8.87 seconds to spawn the instance on the hypervisor.
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:06:00 user nova-compute[75453]: INFO nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Took 8.01 seconds to spawn the instance on the hypervisor.
Nov 28 14:06:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:06:00 user nova-compute[75453]: INFO nova.compute.manager [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Took 9.74 seconds to build instance.
Nov 28 14:06:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3f7de017-f923-47f4-9b1f-7c933d809898 tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "93312f50-72e0-4d65-a125-e6101ad73c91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.955s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:00 user nova-compute[75453]: INFO nova.compute.manager [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Took 9.06 seconds to build instance.
Nov 28 14:06:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8745e894-607e-4167-99ad-c5d3deb7743f tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.219s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:02 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Snapshot image upload complete
Nov 28 14:06:02 user nova-compute[75453]: INFO nova.compute.manager [None req-f6047711-e2a0-4d72-b366-237ba4f6b31a tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Took 7.22 seconds to snapshot the instance on the hypervisor.
Nov 28 14:06:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:06:05 user nova-compute[75453]: INFO nova.compute.claims [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Claim successful on node user
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:06:05 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.policy [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c38a4b08cd204e2a9b313a7740df3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b5137584864cf094d60d14e6f0ab0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:06:05 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Creating image(s)
Nov 28 14:06:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "/opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "/opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "/opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.211s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.212s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk 1073741824" returned: 0 in 0.053s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Cannot resize image /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Ensure instance console log exists: /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Successfully created port: fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Successfully updated port: fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "refresh_cache-527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquired lock "refresh_cache-527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received event network-changed-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Refreshing instance network info cache due to event network-changed-fe80bff8-4392-40bb-942f-b2095b29199c. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] Acquiring lock "refresh_cache-527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Updating instance_info_cache with network_info: [{"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Releasing lock "refresh_cache-527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Instance network_info: |[{"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] Acquired lock "refresh_cache-527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.network.neutron [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Refreshing network info cache for port fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Start _get_guest_xml network_info=[{"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:06:07 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:07 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:06:07 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1436423002',display_name='tempest-AttachVolumeTestJSON-server-1436423002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1436423002',id=27,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFlWuxo8d8nXMdcMC+s1idcRUDtykbajPlJfdAc1yg+5uv17LczFuATBa/Zata1knPZjntuig8DVjH54qv+G83AvNVS75hcVNIAFU8NzNT2nYswUpaffMO1Rffqfi5Fxw==',key_name='tempest-keypair-391843838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-e6w7inhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=527ef61d-2bf4-4e4d-8f21-ce54a9fe876c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6d:fe,bridge_name='br-int',has_traffic_filtering=True,id=fe80bff8-4392-40bb-942f-b2095b29199c,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80bff8-43') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.objects.instance [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'pci_devices' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:06:08 user nova-compute[75453]:   <uuid>527ef61d-2bf4-4e4d-8f21-ce54a9fe876c</uuid>
Nov 28 14:06:08 user nova-compute[75453]:   <name>instance-0000001b</name>
Nov 28 14:06:08 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:06:08 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:06:08 user nova-compute[75453]:   <metadata>
Nov 28 14:06:08 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:06:08 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:06:08 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeTestJSON-server-1436423002</nova:name>
Nov 28 14:06:08 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:06:07</nova:creationTime>
Nov 28 14:06:08 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:06:08 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:06:08 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:06:08 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:06:08 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:06:08 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:06:08 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:06:08 user nova-compute[75453]:       <nova:owner>
Nov 28 14:06:08 user nova-compute[75453]:         <nova:user uuid="c38a4b08cd204e2a9b313a7740df3f3e">tempest-AttachVolumeTestJSON-15045878-project-member</nova:user>
Nov 28 14:06:08 user nova-compute[75453]:         <nova:project uuid="56b5137584864cf094d60d14e6f0ab0f">tempest-AttachVolumeTestJSON-15045878</nova:project>
Nov 28 14:06:08 user nova-compute[75453]:       </nova:owner>
Nov 28 14:06:08 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:06:08 user nova-compute[75453]:       <nova:ports>
Nov 28 14:06:08 user nova-compute[75453]:         <nova:port uuid="fe80bff8-4392-40bb-942f-b2095b29199c">
Nov 28 14:06:08 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 14:06:08 user nova-compute[75453]:         </nova:port>
Nov 28 14:06:08 user nova-compute[75453]:       </nova:ports>
Nov 28 14:06:08 user nova-compute[75453]:     </nova:instance>
Nov 28 14:06:08 user nova-compute[75453]:   </metadata>
Nov 28 14:06:08 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:06:08 user nova-compute[75453]:     <system>
Nov 28 14:06:08 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:06:08 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:06:08 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:06:08 user nova-compute[75453]:       <entry name="serial">527ef61d-2bf4-4e4d-8f21-ce54a9fe876c</entry>
Nov 28 14:06:08 user nova-compute[75453]:       <entry name="uuid">527ef61d-2bf4-4e4d-8f21-ce54a9fe876c</entry>
Nov 28 14:06:08 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:06:08 user nova-compute[75453]:     </system>
Nov 28 14:06:08 user nova-compute[75453]:   </sysinfo>
Nov 28 14:06:08 user nova-compute[75453]:   <os>
Nov 28 14:06:08 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:06:08 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:06:08 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:06:08 user nova-compute[75453]:   </os>
Nov 28 14:06:08 user nova-compute[75453]:   <features>
Nov 28 14:06:08 user nova-compute[75453]:     <acpi/>
Nov 28 14:06:08 user nova-compute[75453]:     <apic/>
Nov 28 14:06:08 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:06:08 user nova-compute[75453]:   </features>
Nov 28 14:06:08 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:06:08 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:06:08 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:06:08 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:06:08 user nova-compute[75453]:   </clock>
Nov 28 14:06:08 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:06:08 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:06:08 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:06:08 user nova-compute[75453]:   </cpu>
Nov 28 14:06:08 user nova-compute[75453]:   <devices>
Nov 28 14:06:08 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:06:08 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:06:08 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk"/>
Nov 28 14:06:08 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:06:08 user nova-compute[75453]:     </disk>
Nov 28 14:06:08 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:06:08 user nova-compute[75453]:       <mac address="fa:16:3e:c1:6d:fe"/>
Nov 28 14:06:08 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:08 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:06:08 user nova-compute[75453]:       <target dev="tapfe80bff8-43"/>
Nov 28 14:06:08 user nova-compute[75453]:     </interface>
Nov 28 14:06:08 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:06:08 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/console.log" append="off"/>
Nov 28 14:06:08 user nova-compute[75453]:     </serial>
Nov 28 14:06:08 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:06:08 user nova-compute[75453]:     <video>
Nov 28 14:06:08 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:08 user nova-compute[75453]:     </video>
Nov 28 14:06:08 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:06:08 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:06:08 user nova-compute[75453]:     </rng>
Nov 28 14:06:08 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:06:08 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:06:08 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:06:08 user nova-compute[75453]:     </memballoon>
Nov 28 14:06:08 user nova-compute[75453]:   </devices>
Nov 28 14:06:08 user nova-compute[75453]: </domain>
Nov 28 14:06:08 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1436423002',display_name='tempest-AttachVolumeTestJSON-server-1436423002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1436423002',id=27,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFlWuxo8d8nXMdcMC+s1idcRUDtykbajPlJfdAc1yg+5uv17LczFuATBa/Zata1knPZjntuig8DVjH54qv+G83AvNVS75hcVNIAFU8NzNT2nYswUpaffMO1Rffqfi5Fxw==',key_name='tempest-keypair-391843838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-e6w7inhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=527ef61d-2bf4-4e4d-8f21-ce54a9fe876c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6d:fe,bridge_name='br-int',has_traffic_filtering=True,id=fe80bff8-4392-40bb-942f-b2095b29199c,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80bff8-43') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG os_vif [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6d:fe,bridge_name='br-int',has_traffic_filtering=True,id=fe80bff8-4392-40bb-942f-b2095b29199c,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80bff8-43') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '982b5356-57ee-555e-b043-db9cf469f2d9', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe80bff8-43, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe80bff8-43, col_values=(('qos', UUID('e0783e1f-d411-4a80-b924-48a84d54922d')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe80bff8-43, col_values=(('external_ids', {'iface-id': 'fe80bff8-4392-40bb-942f-b2095b29199c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:6d:fe', 'vm-uuid': '527ef61d-2bf4-4e4d-8f21-ce54a9fe876c'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:08 user nova-compute[75453]: INFO os_vif [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:6d:fe,bridge_name='br-int',has_traffic_filtering=True,id=fe80bff8-4392-40bb-942f-b2095b29199c,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80bff8-43')
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No VIF found with MAC fa:16:3e:c1:6d:fe, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.network.neutron [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Updated VIF entry in instance network info cache for port fe80bff8-4392-40bb-942f-b2095b29199c. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG nova.network.neutron [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Updating instance_info_cache with network_info: [{"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8a56d67a-3d31-49f3-a351-f6a0a998d270 req-b5b2e4fb-81e8-4145-b503-f30c1a4ad1ed service nova] Releasing lock "refresh_cache-527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received event network-vif-plugged-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] No waiting events found dispatching network-vif-plugged-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:09 user nova-compute[75453]: WARNING nova.compute.manager [req-c92c1608-8bd7-4993-8670-a2ef1dfb1673 req-bd72f81b-92de-4dc0-a594-8f32578efb1f service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received unexpected event network-vif-plugged-fe80bff8-4392-40bb-942f-b2095b29199c for instance with vm_state building and task_state spawning.
Nov 28 14:06:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:06:11 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Instance spawned successfully.
Nov 28 14:06:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:06:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received event network-vif-plugged-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] No waiting events found dispatching network-vif-plugged-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:12 user nova-compute[75453]: WARNING nova.compute.manager [req-4acd61b9-422a-4a6e-bf0e-ed41e9a5bff2 req-91d7495a-d9a0-490a-a85e-0337c6613573 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received unexpected event network-vif-plugged-fe80bff8-4392-40bb-942f-b2095b29199c for instance with vm_state building and task_state spawning.
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:12 user nova-compute[75453]: INFO nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 28 14:06:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:12 user nova-compute[75453]: INFO nova.compute.manager [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Took 7.20 seconds to build instance.
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5709ab08-7c8f-47d3-9cb4-503379231f20 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.340s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:06:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:14 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:14 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8010MB free_disk=25.380481719970703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 140e1e3c-a452-44b9-86d3-0e6232512665 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 807c145e-9d41-4a76-8777-c033276ba96a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 93312f50-72e0-4d65-a125-e6101ad73c91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:06:14 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:06:15 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:06:15 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:06:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:06:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.251s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:06:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:06:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:06:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:06:17 user nova-compute[75453]: INFO nova.compute.claims [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Claim successful on node user
Nov 28 14:06:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:06:18 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:06:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG nova.policy [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9d2a50791634583ace0b93cb1459256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0c4bb4dbc142aeaa4974495fd6f9a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:06:18 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Creating image(s)
Nov 28 14:06:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "/opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "/opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "/opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.650s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Successfully created port: 0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk 1073741824" returned: 0 in 0.051s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Successfully updated port: 0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Cannot resize image /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Ensure instance console log exists: /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "refresh_cache-bed61555-342d-46bc-95c6-4f94b8c5bbe5" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquired lock "refresh_cache-bed61555-342d-46bc-95c6-4f94b8c5bbe5" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received event network-changed-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Refreshing instance network info cache due to event network-changed-0ba0a0df-c224-46cd-b429-d360d113d576. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:06:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] Acquiring lock "refresh_cache-bed61555-342d-46bc-95c6-4f94b8c5bbe5" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Updating instance_info_cache with network_info: [{"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Releasing lock "refresh_cache-bed61555-342d-46bc-95c6-4f94b8c5bbe5" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Instance network_info: |[{"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] Acquired lock "refresh_cache-bed61555-342d-46bc-95c6-4f94b8c5bbe5" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.network.neutron [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Refreshing network info cache for port 0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Start _get_guest_xml network_info=[{"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:06:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2012684965',display_name='tempest-TestServerVolumeAttachmentScenario-server-2012684965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2012684965',id=28,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlM2hXaV3Pzjaj6/HdedyPOs6vnZt3xznkE5NqteNJ5ty/uea2Qpug6fvXqeAxpNO+mcSDzqo4TKu7ZmhNltk+7KVpKJxd2Pa3kqXStGtiqGOQWQzNfe4hrBobKEC8l4A==',key_name='tempest-keypair-1951635767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c0c4bb4dbc142aeaa4974495fd6f9a5',ramdisk_id='',reservation_id='r-n4hgzv8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1145915269',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1145915269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9d2a50791634583ace0b93cb1459256',uuid=bed61555-342d-46bc-95c6-4f94b8c5bbe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Converting VIF {"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=0ba0a0df-c224-46cd-b429-d360d113d576,network=Network(1cdb9e59-4649-491d-b333-8a4aa7e9b358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba0a0df-c2') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'pci_devices' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:06:20 user nova-compute[75453]:   <uuid>bed61555-342d-46bc-95c6-4f94b8c5bbe5</uuid>
Nov 28 14:06:20 user nova-compute[75453]:   <name>instance-0000001c</name>
Nov 28 14:06:20 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:06:20 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:06:20 user nova-compute[75453]:   <metadata>
Nov 28 14:06:20 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:06:20 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:06:20 user nova-compute[75453]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2012684965</nova:name>
Nov 28 14:06:20 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:06:20</nova:creationTime>
Nov 28 14:06:20 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:06:20 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:06:20 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:06:20 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:06:20 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:06:20 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:06:20 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:06:20 user nova-compute[75453]:       <nova:owner>
Nov 28 14:06:20 user nova-compute[75453]:         <nova:user uuid="c9d2a50791634583ace0b93cb1459256">tempest-TestServerVolumeAttachmentScenario-1145915269-project-member</nova:user>
Nov 28 14:06:20 user nova-compute[75453]:         <nova:project uuid="5c0c4bb4dbc142aeaa4974495fd6f9a5">tempest-TestServerVolumeAttachmentScenario-1145915269</nova:project>
Nov 28 14:06:20 user nova-compute[75453]:       </nova:owner>
Nov 28 14:06:20 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:06:20 user nova-compute[75453]:       <nova:ports>
Nov 28 14:06:20 user nova-compute[75453]:         <nova:port uuid="0ba0a0df-c224-46cd-b429-d360d113d576">
Nov 28 14:06:20 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 14:06:20 user nova-compute[75453]:         </nova:port>
Nov 28 14:06:20 user nova-compute[75453]:       </nova:ports>
Nov 28 14:06:20 user nova-compute[75453]:     </nova:instance>
Nov 28 14:06:20 user nova-compute[75453]:   </metadata>
Nov 28 14:06:20 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:06:20 user nova-compute[75453]:     <system>
Nov 28 14:06:20 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:06:20 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:06:20 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:06:20 user nova-compute[75453]:       <entry name="serial">bed61555-342d-46bc-95c6-4f94b8c5bbe5</entry>
Nov 28 14:06:20 user nova-compute[75453]:       <entry name="uuid">bed61555-342d-46bc-95c6-4f94b8c5bbe5</entry>
Nov 28 14:06:20 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:06:20 user nova-compute[75453]:     </system>
Nov 28 14:06:20 user nova-compute[75453]:   </sysinfo>
Nov 28 14:06:20 user nova-compute[75453]:   <os>
Nov 28 14:06:20 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:06:20 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:06:20 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:06:20 user nova-compute[75453]:   </os>
Nov 28 14:06:20 user nova-compute[75453]:   <features>
Nov 28 14:06:20 user nova-compute[75453]:     <acpi/>
Nov 28 14:06:20 user nova-compute[75453]:     <apic/>
Nov 28 14:06:20 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:06:20 user nova-compute[75453]:   </features>
Nov 28 14:06:20 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:06:20 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:06:20 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:06:20 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:06:20 user nova-compute[75453]:   </clock>
Nov 28 14:06:20 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:06:20 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:06:20 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:06:20 user nova-compute[75453]:   </cpu>
Nov 28 14:06:20 user nova-compute[75453]:   <devices>
Nov 28 14:06:20 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:06:20 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:06:20 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk"/>
Nov 28 14:06:20 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:06:20 user nova-compute[75453]:     </disk>
Nov 28 14:06:20 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:06:20 user nova-compute[75453]:       <mac address="fa:16:3e:a5:78:ca"/>
Nov 28 14:06:20 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:20 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:06:20 user nova-compute[75453]:       <target dev="tap0ba0a0df-c2"/>
Nov 28 14:06:20 user nova-compute[75453]:     </interface>
Nov 28 14:06:20 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:06:20 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/console.log" append="off"/>
Nov 28 14:06:20 user nova-compute[75453]:     </serial>
Nov 28 14:06:20 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:06:20 user nova-compute[75453]:     <video>
Nov 28 14:06:20 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:20 user nova-compute[75453]:     </video>
Nov 28 14:06:20 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:06:20 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:06:20 user nova-compute[75453]:     </rng>
Nov 28 14:06:20 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:06:20 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:06:20 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:06:20 user nova-compute[75453]:     </memballoon>
Nov 28 14:06:20 user nova-compute[75453]:   </devices>
Nov 28 14:06:20 user nova-compute[75453]: </domain>
Nov 28 14:06:20 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2012684965',display_name='tempest-TestServerVolumeAttachmentScenario-server-2012684965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2012684965',id=28,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlM2hXaV3Pzjaj6/HdedyPOs6vnZt3xznkE5NqteNJ5ty/uea2Qpug6fvXqeAxpNO+mcSDzqo4TKu7ZmhNltk+7KVpKJxd2Pa3kqXStGtiqGOQWQzNfe4hrBobKEC8l4A==',key_name='tempest-keypair-1951635767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c0c4bb4dbc142aeaa4974495fd6f9a5',ramdisk_id='',reservation_id='r-n4hgzv8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1145915269',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1145915269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9d2a50791634583ace0b93cb1459256',uuid=bed61555-342d-46bc-95c6-4f94b8c5bbe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Converting VIF {"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=0ba0a0df-c224-46cd-b429-d360d113d576,network=Network(1cdb9e59-4649-491d-b333-8a4aa7e9b358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba0a0df-c2') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG os_vif [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=0ba0a0df-c224-46cd-b429-d360d113d576,network=Network(1cdb9e59-4649-491d-b333-8a4aa7e9b358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba0a0df-c2') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1edebbb0-0ee6-50f4-829e-2da01ccc7506', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ba0a0df-c2, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ba0a0df-c2, col_values=(('qos', UUID('eb0d44ad-a6ec-43b2-93bc-08b19c1d940f')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ba0a0df-c2, col_values=(('external_ids', {'iface-id': '0ba0a0df-c224-46cd-b429-d360d113d576', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:78:ca', 'vm-uuid': 'bed61555-342d-46bc-95c6-4f94b8c5bbe5'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:20 user nova-compute[75453]: INFO os_vif [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=0ba0a0df-c224-46cd-b429-d360d113d576,network=Network(1cdb9e59-4649-491d-b333-8a4aa7e9b358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba0a0df-c2')
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:06:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] No VIF found with MAC fa:16:3e:a5:78:ca, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:06:21 user nova-compute[75453]: DEBUG nova.network.neutron [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Updated VIF entry in instance network info cache for port 0ba0a0df-c224-46cd-b429-d360d113d576. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:06:21 user nova-compute[75453]: DEBUG nova.network.neutron [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Updating instance_info_cache with network_info: [{"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-892fe0b9-fd7e-4760-88d2-b77595bbcc09 req-6d7d5819-a13c-4dd3-8b49-f8d8340f8861 service nova] Releasing lock "refresh_cache-bed61555-342d-46bc-95c6-4f94b8c5bbe5" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG nova.compute.manager [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received event network-vif-plugged-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG nova.compute.manager [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] No waiting events found dispatching network-vif-plugged-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:22 user nova-compute[75453]: WARNING nova.compute.manager [req-61a312bc-080d-4158-bc17-b3a3fef71628 req-a0050b09-e395-4a37-90ab-93c366e972bc service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received unexpected event network-vif-plugged-0ba0a0df-c224-46cd-b429-d360d113d576 for instance with vm_state building and task_state spawning.
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:06:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Instance spawned successfully.
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.compute.manager [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received event network-vif-plugged-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.compute.manager [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] No waiting events found dispatching network-vif-plugged-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:24 user nova-compute[75453]: WARNING nova.compute.manager [req-7dda0f15-c58c-4b8f-b604-8ffd5ddf0102 req-77e37ec1-c89c-4327-b240-4b158bc8b035 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received unexpected event network-vif-plugged-0ba0a0df-c224-46cd-b429-d360d113d576 for instance with vm_state building and task_state spawning.
Nov 28 14:06:24 user nova-compute[75453]: INFO nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 28 14:06:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:06:24 user nova-compute[75453]: INFO nova.compute.manager [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Took 6.70 seconds to build instance.
Nov 28 14:06:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f490fde7-5b78-45e8-93a3-f26deea29386 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.843s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:06:26 user nova-compute[75453]: INFO nova.compute.claims [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Claim successful on node user
Nov 28 14:06:26 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:06:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:06:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:06:26 user nova-compute[75453]: DEBUG nova.policy [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4918246c1354b6a923ed07fd6136069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70602cf7cc04aed9d9f010e82cd37b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:06:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Creating image(s)
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "/opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "/opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "/opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.200s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Successfully created port: 152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk 1073741824" returned: 0 in 0.060s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Cannot resize image /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Ensure instance console log exists: /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Successfully updated port: 152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "refresh_cache-85e0a0a1-9ed0-4f33-8a44-33649338b57f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquired lock "refresh_cache-85e0a0a1-9ed0-4f33-8a44-33649338b57f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received event network-changed-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Refreshing instance network info cache due to event network-changed-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] Acquiring lock "refresh_cache-85e0a0a1-9ed0-4f33-8a44-33649338b57f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Updating instance_info_cache with network_info: [{"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Releasing lock "refresh_cache-85e0a0a1-9ed0-4f33-8a44-33649338b57f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Instance network_info: |[{"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] Acquired lock "refresh_cache-85e0a0a1-9ed0-4f33-8a44-33649338b57f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.neutron [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Refreshing network info cache for port 152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Start _get_guest_xml network_info=[{"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:06:28 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:28 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1349513798',display_name='tempest-VolumesActionsTest-instance-1349513798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1349513798',id=29,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d70602cf7cc04aed9d9f010e82cd37b3',ramdisk_id='',reservation_id='r-462b0lgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1229850681',owner_user_name='tempest-VolumesActionsTest-1229850681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:27Z,user_data=None,user_id='e4918246c1354b6a923ed07fd6136069',uuid=85e0a0a1-9ed0-4f33-8a44-33649338b57f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converting VIF {"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:7f:37,bridge_name='br-int',has_traffic_filtering=True,id=152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ba0f2-28') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.objects.instance [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lazy-loading 'pci_devices' on Instance uuid 85e0a0a1-9ed0-4f33-8a44-33649338b57f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:06:28 user nova-compute[75453]:   <uuid>85e0a0a1-9ed0-4f33-8a44-33649338b57f</uuid>
Nov 28 14:06:28 user nova-compute[75453]:   <name>instance-0000001d</name>
Nov 28 14:06:28 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:06:28 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:06:28 user nova-compute[75453]:   <metadata>
Nov 28 14:06:28 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:06:28 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:06:28 user nova-compute[75453]:       <nova:name>tempest-VolumesActionsTest-instance-1349513798</nova:name>
Nov 28 14:06:28 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:06:28</nova:creationTime>
Nov 28 14:06:28 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:06:28 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:06:28 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:06:28 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:06:28 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:06:28 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:06:28 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:06:28 user nova-compute[75453]:       <nova:owner>
Nov 28 14:06:28 user nova-compute[75453]:         <nova:user uuid="e4918246c1354b6a923ed07fd6136069">tempest-VolumesActionsTest-1229850681-project-member</nova:user>
Nov 28 14:06:28 user nova-compute[75453]:         <nova:project uuid="d70602cf7cc04aed9d9f010e82cd37b3">tempest-VolumesActionsTest-1229850681</nova:project>
Nov 28 14:06:28 user nova-compute[75453]:       </nova:owner>
Nov 28 14:06:28 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:06:28 user nova-compute[75453]:       <nova:ports>
Nov 28 14:06:28 user nova-compute[75453]:         <nova:port uuid="152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc">
Nov 28 14:06:28 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:06:28 user nova-compute[75453]:         </nova:port>
Nov 28 14:06:28 user nova-compute[75453]:       </nova:ports>
Nov 28 14:06:28 user nova-compute[75453]:     </nova:instance>
Nov 28 14:06:28 user nova-compute[75453]:   </metadata>
Nov 28 14:06:28 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:06:28 user nova-compute[75453]:     <system>
Nov 28 14:06:28 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:06:28 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:06:28 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:06:28 user nova-compute[75453]:       <entry name="serial">85e0a0a1-9ed0-4f33-8a44-33649338b57f</entry>
Nov 28 14:06:28 user nova-compute[75453]:       <entry name="uuid">85e0a0a1-9ed0-4f33-8a44-33649338b57f</entry>
Nov 28 14:06:28 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:06:28 user nova-compute[75453]:     </system>
Nov 28 14:06:28 user nova-compute[75453]:   </sysinfo>
Nov 28 14:06:28 user nova-compute[75453]:   <os>
Nov 28 14:06:28 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:06:28 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:06:28 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:06:28 user nova-compute[75453]:   </os>
Nov 28 14:06:28 user nova-compute[75453]:   <features>
Nov 28 14:06:28 user nova-compute[75453]:     <acpi/>
Nov 28 14:06:28 user nova-compute[75453]:     <apic/>
Nov 28 14:06:28 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:06:28 user nova-compute[75453]:   </features>
Nov 28 14:06:28 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:06:28 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:06:28 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:06:28 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:06:28 user nova-compute[75453]:   </clock>
Nov 28 14:06:28 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:06:28 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:06:28 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:06:28 user nova-compute[75453]:   </cpu>
Nov 28 14:06:28 user nova-compute[75453]:   <devices>
Nov 28 14:06:28 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:06:28 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:06:28 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk"/>
Nov 28 14:06:28 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:06:28 user nova-compute[75453]:     </disk>
Nov 28 14:06:28 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:06:28 user nova-compute[75453]:       <mac address="fa:16:3e:70:7f:37"/>
Nov 28 14:06:28 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:28 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:06:28 user nova-compute[75453]:       <target dev="tap152ba0f2-28"/>
Nov 28 14:06:28 user nova-compute[75453]:     </interface>
Nov 28 14:06:28 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:06:28 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/console.log" append="off"/>
Nov 28 14:06:28 user nova-compute[75453]:     </serial>
Nov 28 14:06:28 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:06:28 user nova-compute[75453]:     <video>
Nov 28 14:06:28 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:28 user nova-compute[75453]:     </video>
Nov 28 14:06:28 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:06:28 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:06:28 user nova-compute[75453]:     </rng>
Nov 28 14:06:28 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:06:28 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:06:28 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:06:28 user nova-compute[75453]:     </memballoon>
Nov 28 14:06:28 user nova-compute[75453]:   </devices>
Nov 28 14:06:28 user nova-compute[75453]: </domain>
Nov 28 14:06:28 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1349513798',display_name='tempest-VolumesActionsTest-instance-1349513798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1349513798',id=29,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d70602cf7cc04aed9d9f010e82cd37b3',ramdisk_id='',reservation_id='r-462b0lgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1229850681',owner_user_name='tempest-VolumesActionsTest-1229850681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:27Z,user_data=None,user_id='e4918246c1354b6a923ed07fd6136069',uuid=85e0a0a1-9ed0-4f33-8a44-33649338b57f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converting VIF {"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:7f:37,bridge_name='br-int',has_traffic_filtering=True,id=152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ba0f2-28') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG os_vif [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:7f:37,bridge_name='br-int',has_traffic_filtering=True,id=152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ba0f2-28') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ec68096-8a6d-5e56-8b10-f8075051fc9a', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap152ba0f2-28, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap152ba0f2-28, col_values=(('qos', UUID('1f36b5b4-09e2-4905-b8c9-79b7fbd80f2f')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap152ba0f2-28, col_values=(('external_ids', {'iface-id': '152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:7f:37', 'vm-uuid': '85e0a0a1-9ed0-4f33-8a44-33649338b57f'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:28 user nova-compute[75453]: INFO os_vif [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:7f:37,bridge_name='br-int',has_traffic_filtering=True,id=152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ba0f2-28')
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] No VIF found with MAC fa:16:3e:70:7f:37, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.neutron [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Updated VIF entry in instance network info cache for port 152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG nova.network.neutron [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Updating instance_info_cache with network_info: [{"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-213181f5-6711-45da-8d32-50d9dff4ffaa req-c403a874-16ae-42be-9d03-39dfe7569ee7 service nova] Releasing lock "refresh_cache-85e0a0a1-9ed0-4f33-8a44-33649338b57f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received event network-vif-plugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] Acquiring lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] No waiting events found dispatching network-vif-plugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:30 user nova-compute[75453]: WARNING nova.compute.manager [req-92212719-c10c-4923-90ca-60dcdf99c84c req-c69ce825-c814-49e2-a874-1c62f32d49c9 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received unexpected event network-vif-plugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance with vm_state building and task_state spawning.
Nov 28 14:06:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received event network-vif-plugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] Acquiring lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] No waiting events found dispatching network-vif-plugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:32 user nova-compute[75453]: WARNING nova.compute.manager [req-8e16b66d-e69f-41db-a01f-5f419a281abd req-53f59a79-82ea-47f9-99f7-9dc9e7b7f825 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received unexpected event network-vif-plugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance with vm_state building and task_state spawning.
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:06:32 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Instance spawned successfully.
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:32 user nova-compute[75453]: INFO nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 28 14:06:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:06:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:32 user nova-compute[75453]: INFO nova.compute.manager [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Took 6.28 seconds to build instance.
Nov 28 14:06:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-78bcd892-1580-4cbf-976a-a781c66177b4 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.376s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:06:38 user nova-compute[75453]: INFO nova.compute.claims [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Claim successful on node user
Nov 28 14:06:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:06:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:06:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:06:38 user nova-compute[75453]: DEBUG nova.policy [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:06:39 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Creating image(s)
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk 1073741824" returned: 0 in 0.051s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Successfully created port: 90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Cannot resize image /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Ensure instance console log exists: /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Successfully updated port: 90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "refresh_cache-62c8d241-26ff-431e-98de-56c2941cf895" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquired lock "refresh_cache-62c8d241-26ff-431e-98de-56c2941cf895" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.compute.manager [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-changed-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.compute.manager [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Refreshing instance network info cache due to event network-changed-90875e2b-ad20-4e71-903c-08ab27b78d96. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] Acquiring lock "refresh_cache-62c8d241-26ff-431e-98de-56c2941cf895" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Updating instance_info_cache with network_info: [{"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Releasing lock "refresh_cache-62c8d241-26ff-431e-98de-56c2941cf895" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Instance network_info: |[{"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] Acquired lock "refresh_cache-62c8d241-26ff-431e-98de-56c2941cf895" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Refreshing network info cache for port 90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Start _get_guest_xml network_info=[{"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:06:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1682840901',display_name='tempest-tempest.common.compute-instance-1682840901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1682840901',id=30,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXwEXKVXgWWKg7f1++x+TJXhG7IKT/xO+VHfqjWh6vTLUqjBHnnqIN9BD48DwKAR5bFvefKT51EUFBNmqbL89LQSkNMn22MOEyL4az1iMY6GaI68+ZEUNFcu40O71nmtw==',key_name='tempest-keypair-1093862542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-gj7iwpw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=62c8d241-26ff-431e-98de-56c2941cf895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'pci_devices' on Instance uuid 62c8d241-26ff-431e-98de-56c2941cf895 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:06:40 user nova-compute[75453]:   <uuid>62c8d241-26ff-431e-98de-56c2941cf895</uuid>
Nov 28 14:06:40 user nova-compute[75453]:   <name>instance-0000001e</name>
Nov 28 14:06:40 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:06:40 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:06:40 user nova-compute[75453]:   <metadata>
Nov 28 14:06:40 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:06:40 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:06:40 user nova-compute[75453]:       <nova:name>tempest-tempest.common.compute-instance-1682840901</nova:name>
Nov 28 14:06:40 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:06:40</nova:creationTime>
Nov 28 14:06:40 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:06:40 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:06:40 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:06:40 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:06:40 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:06:40 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:06:40 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:06:40 user nova-compute[75453]:       <nova:owner>
Nov 28 14:06:40 user nova-compute[75453]:         <nova:user uuid="9f84ee8a311d4619b7d51c2066d4775f">tempest-ServerActionsTestOtherA-1445772683-project-member</nova:user>
Nov 28 14:06:40 user nova-compute[75453]:         <nova:project uuid="82ab030af40f43e28b5f1b7ce64c50a8">tempest-ServerActionsTestOtherA-1445772683</nova:project>
Nov 28 14:06:40 user nova-compute[75453]:       </nova:owner>
Nov 28 14:06:40 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:06:40 user nova-compute[75453]:       <nova:ports>
Nov 28 14:06:40 user nova-compute[75453]:         <nova:port uuid="90875e2b-ad20-4e71-903c-08ab27b78d96">
Nov 28 14:06:40 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:06:40 user nova-compute[75453]:         </nova:port>
Nov 28 14:06:40 user nova-compute[75453]:       </nova:ports>
Nov 28 14:06:40 user nova-compute[75453]:     </nova:instance>
Nov 28 14:06:40 user nova-compute[75453]:   </metadata>
Nov 28 14:06:40 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:06:40 user nova-compute[75453]:     <system>
Nov 28 14:06:40 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:06:40 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:06:40 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:06:40 user nova-compute[75453]:       <entry name="serial">62c8d241-26ff-431e-98de-56c2941cf895</entry>
Nov 28 14:06:40 user nova-compute[75453]:       <entry name="uuid">62c8d241-26ff-431e-98de-56c2941cf895</entry>
Nov 28 14:06:40 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:06:40 user nova-compute[75453]:     </system>
Nov 28 14:06:40 user nova-compute[75453]:   </sysinfo>
Nov 28 14:06:40 user nova-compute[75453]:   <os>
Nov 28 14:06:40 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:06:40 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:06:40 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:06:40 user nova-compute[75453]:   </os>
Nov 28 14:06:40 user nova-compute[75453]:   <features>
Nov 28 14:06:40 user nova-compute[75453]:     <acpi/>
Nov 28 14:06:40 user nova-compute[75453]:     <apic/>
Nov 28 14:06:40 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:06:40 user nova-compute[75453]:   </features>
Nov 28 14:06:40 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:06:40 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:06:40 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:06:40 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:06:40 user nova-compute[75453]:   </clock>
Nov 28 14:06:40 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:06:40 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:06:40 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:06:40 user nova-compute[75453]:   </cpu>
Nov 28 14:06:40 user nova-compute[75453]:   <devices>
Nov 28 14:06:40 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:06:40 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:06:40 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk"/>
Nov 28 14:06:40 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:06:40 user nova-compute[75453]:     </disk>
Nov 28 14:06:40 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:06:40 user nova-compute[75453]:       <mac address="fa:16:3e:1f:0b:54"/>
Nov 28 14:06:40 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:40 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:06:40 user nova-compute[75453]:       <target dev="tap90875e2b-ad"/>
Nov 28 14:06:40 user nova-compute[75453]:     </interface>
Nov 28 14:06:40 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:06:40 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/console.log" append="off"/>
Nov 28 14:06:40 user nova-compute[75453]:     </serial>
Nov 28 14:06:40 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:06:40 user nova-compute[75453]:     <video>
Nov 28 14:06:40 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:40 user nova-compute[75453]:     </video>
Nov 28 14:06:40 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:06:40 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:06:40 user nova-compute[75453]:     </rng>
Nov 28 14:06:40 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:06:40 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:06:40 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:06:40 user nova-compute[75453]:     </memballoon>
Nov 28 14:06:40 user nova-compute[75453]:   </devices>
Nov 28 14:06:40 user nova-compute[75453]: </domain>
Nov 28 14:06:40 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1682840901',display_name='tempest-tempest.common.compute-instance-1682840901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1682840901',id=30,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXwEXKVXgWWKg7f1++x+TJXhG7IKT/xO+VHfqjWh6vTLUqjBHnnqIN9BD48DwKAR5bFvefKT51EUFBNmqbL89LQSkNMn22MOEyL4az1iMY6GaI68+ZEUNFcu40O71nmtw==',key_name='tempest-keypair-1093862542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-gj7iwpw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=62c8d241-26ff-431e-98de-56c2941cf895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG os_vif [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '495b464d-26bc-5e9c-b6cc-2acd0d792591', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90875e2b-ad, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90875e2b-ad, col_values=(('qos', UUID('120633cc-702c-4a6a-8c1e-42093d0396e2')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90875e2b-ad, col_values=(('external_ids', {'iface-id': '90875e2b-ad20-4e71-903c-08ab27b78d96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:0b:54', 'vm-uuid': '62c8d241-26ff-431e-98de-56c2941cf895'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:40 user nova-compute[75453]: INFO os_vif [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad')
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No VIF found with MAC fa:16:3e:1f:0b:54, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Updated VIF entry in instance network info cache for port 90875e2b-ad20-4e71-903c-08ab27b78d96. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Updating instance_info_cache with network_info: [{"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0200b46f-068a-49c0-a9fb-d62005758cd7 req-ee6725aa-4c51-40b9-bbe6-d3f309bf2ebe service nova] Releasing lock "refresh_cache-62c8d241-26ff-431e-98de-56c2941cf895" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:42 user nova-compute[75453]: WARNING nova.compute.manager [req-e6e0d8f4-48b4-4912-8db6-f739e351e7d6 req-dfbc513f-6fde-4c82-83e6-e7a0a64e784b service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state building and task_state spawning.
Nov 28 14:06:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:42 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:06:43 user nova-compute[75453]: INFO nova.compute.claims [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Claim successful on node user
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:06:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.policy [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e109047aa8a34d8aad03c6c0dc14c7c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4056ca714ed4e85878d7819ef63b20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:06:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Creating image(s)
Nov 28 14:06:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "/opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "/opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "7592661aac8b9cee9c0b21ecc40cd052731bd8b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "7592661aac8b9cee9c0b21ecc40cd052731bd8b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:44 user nova-compute[75453]: WARNING nova.compute.manager [req-dc1d234f-8b8c-48dd-80a3-8f5f2f99a840 req-5b33aaa1-6bc6-4151-965e-7629019edf91 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state building and task_state spawning.
Nov 28 14:06:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2.part --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.virt.images [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 6530f2f4-cb90-4204-90fe-226e4fc806c7 was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2.part /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Successfully created port: 8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:06:44 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Instance spawned successfully.
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:44 user nova-compute[75453]: INFO nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 28 14:06:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2.part /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2.converted" returned: 0 in 0.316s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:44 user nova-compute[75453]: INFO nova.compute.manager [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Took 6.58 seconds to build instance.
Nov 28 14:06:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e35eda0-0964-45e4-8b25-580b03d48b3f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.694s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "7592661aac8b9cee9c0b21ecc40cd052731bd8b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.316s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2 --force-share --output=json" returned: 0 in 0.189s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "7592661aac8b9cee9c0b21ecc40cd052731bd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "7592661aac8b9cee9c0b21ecc40cd052731bd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Successfully updated port: 8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "refresh_cache-8ea60b55-d974-4262-9413-37459394f8a6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquired lock "refresh_cache-8ea60b55-d974-4262-9413-37459394f8a6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2 --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2,backing_fmt=raw /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2,backing_fmt=raw /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk 1073741824" returned: 0 in 0.058s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "7592661aac8b9cee9c0b21ecc40cd052731bd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Updating instance_info_cache with network_info: [{"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Releasing lock "refresh_cache-8ea60b55-d974-4262-9413-37459394f8a6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Instance network_info: |[{"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2 --force-share --output=json" returned: 0 in 0.232s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:06:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Cannot resize image /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Ensure instance console log exists: /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Start _get_guest_xml network_info=[{"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T14:06:40Z,direct_url=<?>,disk_format='qcow2',id=6530f2f4-cb90-4204-90fe-226e4fc806c7,min_disk=0,min_ram=0,name='tempest-scenario-img--1187860178',owner='f4056ca714ed4e85878d7819ef63b20c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T14:06:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '6530f2f4-cb90-4204-90fe-226e4fc806c7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:06:46 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:46 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T14:06:40Z,direct_url=<?>,disk_format='qcow2',id=6530f2f4-cb90-4204-90fe-226e4fc806c7,min_disk=0,min_ram=0,name='tempest-scenario-img--1187860178',owner='f4056ca714ed4e85878d7819ef63b20c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T14:06:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-302157245',display_name='tempest-TestMinimumBasicScenario-server-302157245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-302157245',id=31,image_ref='6530f2f4-cb90-4204-90fe-226e4fc806c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa19ae4ZpRTk8W8Dy0ei1mbIqo2DyDhgzSWjJaNvQeFzWl77MekDwIF3aQsbXH5GjTuclZvjusBW70UuFW4tBl6XBUDa/gQEGo6iKrUvg98hB7Vo/QDIUMrAZNkg2P19Q==',key_name='tempest-TestMinimumBasicScenario-61460895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4056ca714ed4e85878d7819ef63b20c',ramdisk_id='',reservation_id='r-caeol4fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6530f2f4-cb90-4204-90fe-226e4fc806c7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2080131890',owner_user_name='tempest-TestMinimumBasicScenario-2080131890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:44Z,user_data=None,user_id='e109047aa8a34d8aad03c6c0dc14c7c8',uuid=8ea60b55-d974-4262-9413-37459394f8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converting VIF {"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8b8020db-6358-4061-8494-c21f704791fb,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8020db-63') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ea60b55-d974-4262-9413-37459394f8a6 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:06:46 user nova-compute[75453]:   <uuid>8ea60b55-d974-4262-9413-37459394f8a6</uuid>
Nov 28 14:06:46 user nova-compute[75453]:   <name>instance-0000001f</name>
Nov 28 14:06:46 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:06:46 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:06:46 user nova-compute[75453]:   <metadata>
Nov 28 14:06:46 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:06:46 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:06:46 user nova-compute[75453]:       <nova:name>tempest-TestMinimumBasicScenario-server-302157245</nova:name>
Nov 28 14:06:46 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:06:46</nova:creationTime>
Nov 28 14:06:46 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:06:46 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:06:46 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:06:46 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:06:46 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:06:46 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:06:46 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:06:46 user nova-compute[75453]:       <nova:owner>
Nov 28 14:06:46 user nova-compute[75453]:         <nova:user uuid="e109047aa8a34d8aad03c6c0dc14c7c8">tempest-TestMinimumBasicScenario-2080131890-project-member</nova:user>
Nov 28 14:06:46 user nova-compute[75453]:         <nova:project uuid="f4056ca714ed4e85878d7819ef63b20c">tempest-TestMinimumBasicScenario-2080131890</nova:project>
Nov 28 14:06:46 user nova-compute[75453]:       </nova:owner>
Nov 28 14:06:46 user nova-compute[75453]:       <nova:root type="image" uuid="6530f2f4-cb90-4204-90fe-226e4fc806c7"/>
Nov 28 14:06:46 user nova-compute[75453]:       <nova:ports>
Nov 28 14:06:46 user nova-compute[75453]:         <nova:port uuid="8b8020db-6358-4061-8494-c21f704791fb">
Nov 28 14:06:46 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 14:06:46 user nova-compute[75453]:         </nova:port>
Nov 28 14:06:46 user nova-compute[75453]:       </nova:ports>
Nov 28 14:06:46 user nova-compute[75453]:     </nova:instance>
Nov 28 14:06:46 user nova-compute[75453]:   </metadata>
Nov 28 14:06:46 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:06:46 user nova-compute[75453]:     <system>
Nov 28 14:06:46 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:06:46 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:06:46 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:06:46 user nova-compute[75453]:       <entry name="serial">8ea60b55-d974-4262-9413-37459394f8a6</entry>
Nov 28 14:06:46 user nova-compute[75453]:       <entry name="uuid">8ea60b55-d974-4262-9413-37459394f8a6</entry>
Nov 28 14:06:46 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:06:46 user nova-compute[75453]:     </system>
Nov 28 14:06:46 user nova-compute[75453]:   </sysinfo>
Nov 28 14:06:46 user nova-compute[75453]:   <os>
Nov 28 14:06:46 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:06:46 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:06:46 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:06:46 user nova-compute[75453]:   </os>
Nov 28 14:06:46 user nova-compute[75453]:   <features>
Nov 28 14:06:46 user nova-compute[75453]:     <acpi/>
Nov 28 14:06:46 user nova-compute[75453]:     <apic/>
Nov 28 14:06:46 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:06:46 user nova-compute[75453]:   </features>
Nov 28 14:06:46 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:06:46 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:06:46 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:06:46 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:06:46 user nova-compute[75453]:   </clock>
Nov 28 14:06:46 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:06:46 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:06:46 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:06:46 user nova-compute[75453]:   </cpu>
Nov 28 14:06:46 user nova-compute[75453]:   <devices>
Nov 28 14:06:46 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:06:46 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:06:46 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk"/>
Nov 28 14:06:46 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:06:46 user nova-compute[75453]:     </disk>
Nov 28 14:06:46 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:06:46 user nova-compute[75453]:       <mac address="fa:16:3e:eb:12:e9"/>
Nov 28 14:06:46 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:46 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:06:46 user nova-compute[75453]:       <target dev="tap8b8020db-63"/>
Nov 28 14:06:46 user nova-compute[75453]:     </interface>
Nov 28 14:06:46 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:06:46 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/console.log" append="off"/>
Nov 28 14:06:46 user nova-compute[75453]:     </serial>
Nov 28 14:06:46 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:06:46 user nova-compute[75453]:     <video>
Nov 28 14:06:46 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:06:46 user nova-compute[75453]:     </video>
Nov 28 14:06:46 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:06:46 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:06:46 user nova-compute[75453]:     </rng>
Nov 28 14:06:46 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:06:46 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:06:46 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:06:46 user nova-compute[75453]:     </memballoon>
Nov 28 14:06:46 user nova-compute[75453]:   </devices>
Nov 28 14:06:46 user nova-compute[75453]: </domain>
Nov 28 14:06:46 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-302157245',display_name='tempest-TestMinimumBasicScenario-server-302157245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-302157245',id=31,image_ref='6530f2f4-cb90-4204-90fe-226e4fc806c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa19ae4ZpRTk8W8Dy0ei1mbIqo2DyDhgzSWjJaNvQeFzWl77MekDwIF3aQsbXH5GjTuclZvjusBW70UuFW4tBl6XBUDa/gQEGo6iKrUvg98hB7Vo/QDIUMrAZNkg2P19Q==',key_name='tempest-TestMinimumBasicScenario-61460895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4056ca714ed4e85878d7819ef63b20c',ramdisk_id='',reservation_id='r-caeol4fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6530f2f4-cb90-4204-90fe-226e4fc806c7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2080131890',owner_user_name='tempest-TestMinimumBasicScenario-2080131890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:06:44Z,user_data=None,user_id='e109047aa8a34d8aad03c6c0dc14c7c8',uuid=8ea60b55-d974-4262-9413-37459394f8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converting VIF {"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8b8020db-6358-4061-8494-c21f704791fb,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8020db-63') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG os_vif [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8b8020db-6358-4061-8494-c21f704791fb,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8020db-63') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49583489-a976-59a7-986d-66bb6665d812', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b8020db-63, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b8020db-63, col_values=(('qos', UUID('5acec7eb-682c-4924-95fd-3a6e3bfa6182')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b8020db-63, col_values=(('external_ids', {'iface-id': '8b8020db-6358-4061-8494-c21f704791fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:12:e9', 'vm-uuid': '8ea60b55-d974-4262-9413-37459394f8a6'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:46 user nova-compute[75453]: INFO os_vif [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8b8020db-6358-4061-8494-c21f704791fb,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8020db-63')
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] No VIF found with MAC fa:16:3e:eb:12:e9, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received event network-changed-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Refreshing instance network info cache due to event network-changed-8b8020db-6358-4061-8494-c21f704791fb. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] Acquiring lock "refresh_cache-8ea60b55-d974-4262-9413-37459394f8a6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] Acquired lock "refresh_cache-8ea60b55-d974-4262-9413-37459394f8a6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Refreshing network info cache for port 8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:06:47 user nova-compute[75453]: DEBUG nova.network.neutron [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Updated VIF entry in instance network info cache for port 8b8020db-6358-4061-8494-c21f704791fb. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:06:47 user nova-compute[75453]: DEBUG nova.network.neutron [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Updating instance_info_cache with network_info: [{"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e72a2af7-f5e7-4be5-9d82-8ea7f8b24371 req-d9fde07f-a6f1-4087-af7e-f837c4beea65 service nova] Releasing lock "refresh_cache-8ea60b55-d974-4262-9413-37459394f8a6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received event network-vif-plugged-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] No waiting events found dispatching network-vif-plugged-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:48 user nova-compute[75453]: WARNING nova.compute.manager [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received unexpected event network-vif-plugged-8b8020db-6358-4061-8494-c21f704791fb for instance with vm_state building and task_state spawning.
Nov 28 14:06:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received event network-vif-plugged-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] No waiting events found dispatching network-vif-plugged-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:48 user nova-compute[75453]: WARNING nova.compute.manager [req-49361dd6-52b2-4fb3-8da5-a576ebcf7525 req-82abfed8-c705-490f-9628-56c5a4e7dbd9 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received unexpected event network-vif-plugged-8b8020db-6358-4061-8494-c21f704791fb for instance with vm_state building and task_state spawning.
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:06:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Instance spawned successfully.
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:06:50 user nova-compute[75453]: INFO nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 28 14:06:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:06:50 user nova-compute[75453]: INFO nova.compute.manager [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Took 7.07 seconds to build instance.
Nov 28 14:06:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ea95dfa3-d877-482d-9586-ba83d52830ca tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.326s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-changed-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Refreshing instance network info cache due to event network-changed-d02ad480-f01f-442a-a00e-7dca16a27d3d. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:06:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] Acquiring lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:06:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] Acquired lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:06:52 user nova-compute[75453]: DEBUG nova.network.neutron [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Refreshing network info cache for port d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:06:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:52 user nova-compute[75453]: DEBUG nova.network.neutron [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updated VIF entry in instance network info cache for port d02ad480-f01f-442a-a00e-7dca16a27d3d. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:06:52 user nova-compute[75453]: DEBUG nova.network.neutron [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating instance_info_cache with network_info: [{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:06:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1fb717ba-999c-4d7c-b0c8-74aa9e54965b req-da04e95e-365c-4e72-a541-9ea6947d3b2e service nova] Releasing lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:56 user nova-compute[75453]: INFO nova.compute.manager [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Shelving
Nov 28 14:06:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-unplugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] No waiting events found dispatching network-vif-unplugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:56 user nova-compute[75453]: WARNING nova.compute.manager [req-8405f1c8-7fa8-4da7-bf2c-4581c3af4bff req-ab6cb835-725f-4ac4-9dbb-9ac6cb0084b9 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received unexpected event network-vif-unplugged-d02ad480-f01f-442a-a00e-7dca16a27d3d for instance with vm_state active and task_state shelving.
Nov 28 14:06:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance destroyed successfully.
Nov 28 14:06:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Beginning cold snapshot process
Nov 28 14:06:57 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:06:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk /opt/stack/data/nova/instances/snapshots/tmpifi5p99l/b3b2b3fd64ee41ac9e6ec7965b29e1a6 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:06:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:06:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk /opt/stack/data/nova/instances/snapshots/tmpifi5p99l/b3b2b3fd64ee41ac9e6ec7965b29e1a6" returned: 0 in 1.076s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:06:58 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Snapshot extracted, beginning image upload
Nov 28 14:06:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:06:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:06:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:06:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:06:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] No waiting events found dispatching network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:06:58 user nova-compute[75453]: WARNING nova.compute.manager [req-63c9a4a8-6bb1-445f-813d-a7b6157b64d0 req-a25a077f-caf5-4041-8767-2769a58a0d2a service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received unexpected event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 14:07:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Snapshot image upload complete
Nov 28 14:07:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:07:01 user nova-compute[75453]: INFO nova.compute.manager [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Shelve offloading
Nov 28 14:07:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance destroyed successfully.
Nov 28 14:07:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:07:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:07:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquired lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:07:01 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:07:01 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating instance_info_cache with network_info: [{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Releasing lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:07:02 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance destroyed successfully.
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'resources' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-822996976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-822996976',id=24,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRx1CaHhz7T4iWZHcZU/u7mxv1qFYSTYPVbEd+1AG15eK9htz2w/1zgpgePgXRBe/1I2oHV07JSN71mZsmDsoUxJkz8utVlRxN75p5/8zRBkg+ecBdhPIs3fNz9MW2gDA==',key_name='tempest-keypair-1276374203',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-h8fb3xp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member',shelved_at='2023-11-28T14:07:01.154841',shelved_host='user',shelved_image_id='86f857ee-58c7-403f-bab4-ef42dbf72c2a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:06:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=140e1e3c-a452-44b9-86d3-0e6232512665,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG os_vif [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd02ad480-f0, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-changed-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Refreshing instance network info cache due to event network-changed-d02ad480-f01f-442a-a00e-7dca16a27d3d. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] Acquiring lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] Acquired lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Refreshing network info cache for port d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86f1c8d9-19ca-4ba1-a710-dd30dc5b8d24) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:02 user nova-compute[75453]: INFO os_vif [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0')
Nov 28 14:07:02 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Deleting instance files /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665_del
Nov 28 14:07:02 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Deletion of /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665_del complete
Nov 28 14:07:02 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Deleted allocations for instance 140e1e3c-a452-44b9-86d3-0e6232512665
Nov 28 14:07:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'numa_topology' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.objects.base [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<140e1e3c-a452-44b9-86d3-0e6232512665> lazy-loaded attributes: resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updated VIF entry in instance network info cache for port d02ad480-f01f-442a-a00e-7dca16a27d3d. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating instance_info_cache with network_info: [{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd02ad480-f0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-92487398-3fdf-45c8-80d1-707bda71ad4c req-ef41c661-c8f8-4947-b8c5-fd606eaeff83 service nova] Releasing lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d92ad227-a2c9-4816-bb6b-f5ad7131dc65 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.620s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "db5b1a94-7308-4e99-bc57-025611be1f23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:07:04 user nova-compute[75453]: INFO nova.compute.claims [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Claim successful on node user
Nov 28 14:07:04 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG nova.network.neutron [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:07:04 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:07:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:07:04 user nova-compute[75453]: DEBUG nova.policy [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:07:04 user nova-compute[75453]: INFO nova.virt.block_device [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Booting with blank volume at /dev/vda
Nov 28 14:07:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Successfully created port: f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Successfully updated port: f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquired lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-changed-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Refreshing instance network info cache due to event network-changed-f6df96a1-9fa2-447c-b0f6-9f53f1521839. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] Acquiring lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updating instance_info_cache with network_info: [{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Releasing lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Instance network_info: |[{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] Acquired lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Refreshing network info cache for port f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updated VIF entry in instance network info cache for port f6df96a1-9fa2-447c-b0f6-9f53f1521839. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updating instance_info_cache with network_info: [{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d68590fb-9d57-43db-b11b-6c03403978f1 req-cf5ea089-015c-478f-9e83-9427914e423a service nova] Releasing lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:07:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG os_brick.utils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1533db-9363-44e9-ac43-7515d4197937]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea59743-0516-406b-80bf-89cf029a045f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d7d38a-63e1-417a-8890-3972128b41d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8678f22-81d9-49e1-bd96-1a9becb24e15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:07:10 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:07:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50564fa-c6f0-435d-aa89-6992e36d6e79]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG os_brick.utils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:07:10 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updating existing volume attachment record: beadcb0e-cfbb-4fca-ae82-407f2e502f36 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:07:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:07:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:07:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:07:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:07:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updating instance_info_cache with network_info: [{"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG nova.compute.manager [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG nova.compute.manager [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing instance network info cache due to event network-changed-36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] Acquiring lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] Acquired lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG nova.network.neutron [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Refreshing network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:07:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:14 user nova-compute[75453]: INFO nova.compute.manager [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Terminating instance
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.compute.manager [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-unplugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.compute.manager [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] No waiting events found dispatching network-vif-unplugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.compute.manager [req-d3e7b418-dae7-4f3a-9502-d352e3f0e51d req-610f46c6-5734-42fc-9608-9bf42677170b service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-unplugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.network.neutron [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updated VIF entry in instance network info cache for port 36fe7f7b-64c5-47bd-815b-b61516ad2167. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.network.neutron [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [{"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2063e82f-4aff-4db3-b045-1b7dab166885 req-92e3b26a-d907-4dcf-a1c8-957687d623ad service nova] Releasing lock "refresh_cache-807c145e-9d41-4a76-8777-c033276ba96a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Instance destroyed successfully.
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.objects.instance [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lazy-loading 'resources' on Instance uuid 807c145e-9d41-4a76-8777-c033276ba96a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1023395681',display_name='tempest-TestShelveInstance-server-1023395681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1023395681',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6z3du+pmuEBKboST02586Of9o2SE842jAb049GFnMxRW83rmvet7dpNb4t0VRkhFGxC/tIx+XacRSvu0RJvjpQharev3k6UhzGalKPyeiOSo5afml9y35O1EfkG0ODGQ==',key_name='tempest-TestShelveInstance-1470109784',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:05:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5606d16b2f44aa0a189a0b20d687cbc',ramdisk_id='',reservation_id='r-00jaku0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-511272115',owner_user_name='tempest-TestShelveInstance-511272115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:05:39Z,user_data=None,user_id='6f9c41c5c12e4ce0b5848dc319ceff1d',uuid=807c145e-9d41-4a76-8777-c033276ba96a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converting VIF {"id": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "address": "fa:16:3e:36:e4:41", "network": {"id": "e4b10530-95db-4de1-b927-6b73d44996b1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1569466090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5606d16b2f44aa0a189a0b20d687cbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe7f7b-64", "ovs_interfaceid": "36fe7f7b-64c5-47bd-815b-b61516ad2167", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_vif [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36fe7f7b-64, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c37ec18-d1f7-494a-a150-76476267ed78) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:14 user nova-compute[75453]: INFO os_vif [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:e4:41,bridge_name='br-int',has_traffic_filtering=True,id=36fe7f7b-64c5-47bd-815b-b61516ad2167,network=Network(e4b10530-95db-4de1-b927-6b73d44996b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe7f7b-64')
Nov 28 14:07:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPxhjlQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:07:14 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d7cd08-06cb-4e87-a321-4744232845dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:07:14 user nova-compute[75453]: No targets found.
Nov 28 14:07:14 user nova-compute[75453]: iSNS:
Nov 28 14:07:14 user nova-compute[75453]: No targets found.
Nov 28 14:07:14 user nova-compute[75453]: STATIC:
Nov 28 14:07:14 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59
Nov 28 14:07:14 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:07:14 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:07:14 user nova-compute[75453]: FIRMWARE:
Nov 28 14:07:14 user nova-compute[75453]: No targets found.
Nov 28 14:07:14 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:07:14 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:07:14 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7dfe64-b9f7-4082-8eee-740a51b7573a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07c4192-60b3-4ed2-a1cb-8c9d198e8735]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:07:14 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 (non-flash)
Nov 28 14:07:14 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0218519750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[087e1b14-c8d6-4fea-bb9f-229a773e1a9e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7a85a8-50b1-44fa-8279-d7255fd1473e]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1136259f-cd33-4307-b02f-ed3f88e7efd4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cebde41-60f3-4a31-9cb9-fdd1ba12e482]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_12ffd7a3', '/dev/disk/by-id/scsi-23861303463623234', '/dev/disk/by-id/scsi-1SCST_BIO12ffd7a3-8a04cb24581c5849') {{(pid=86546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ecafee-d035-420c-8c26-274fe369d68a]: (4, None) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b4e14a-f06d-4cbf-8047-1b034cd74361]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36a9511-8db6-417b-8f03-403d5699c4d4]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260]
Nov 28 14:07:15 user nova-compute[75453]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59, portal: 172.16.0.220,3260] successful.
Nov 28 14:07:15 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30f0930-b3ec-4e8d-99ae-cd205eb43c59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd0d33-4941-4553-94e4-6323d018e9a5]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] <== disconnect_volume: return (339ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:07:15 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Deleting instance files /opt/stack/data/nova/instances/807c145e-9d41-4a76-8777-c033276ba96a_del
Nov 28 14:07:15 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Deletion of /opt/stack/data/nova/instances/807c145e-9d41-4a76-8777-c033276ba96a_del complete
Nov 28 14:07:15 user nova-compute[75453]: INFO nova.compute.manager [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:15 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Took 0.40 seconds to deallocate network for instance.
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:15 user nova-compute[75453]: DEBUG nova.compute.manager [req-5eb655eb-c248-4cbc-a5b2-fec9d680c463 req-6f4f4885-66c2-4b51-aa13-a67ed84bfb8e service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-deleted-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] Acquiring lock "807c145e-9d41-4a76-8777-c033276ba96a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] Lock "807c145e-9d41-4a76-8777-c033276ba96a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] No waiting events found dispatching network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:07:16 user nova-compute[75453]: WARNING nova.compute.manager [req-b4e41007-a1b2-4711-b6ba-d8cc9a231444 req-80c970df-edf4-4c22-9da2-10f41002cf75 service nova] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Received unexpected event network-vif-plugged-36fe7f7b-64c5-47bd-815b-b61516ad2167 for instance with vm_state active and task_state deleting.
Nov 28 14:07:16 user nova-compute[75453]: INFO nova.compute.manager [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Took 0.78 seconds to detach 1 volumes for instance.
Nov 28 14:07:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] [instance: 807c145e-9d41-4a76-8777-c033276ba96a] Deleting volume: f30f0930-b3ec-4e8d-99ae-cd205eb43c59 {{(pid=75453) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:07:16 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:17 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Deleted allocations for instance 807c145e-9d41-4a76-8777-c033276ba96a
Nov 28 14:07:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:07:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7183MB free_disk=25.13039779663086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82237e7f-44bb-4345-92bc-cd2e7bc5c2a6 tempest-TestShelveInstance-511272115 tempest-TestShelveInstance-511272115-project-member] Lock "807c145e-9d41-4a76-8777-c033276ba96a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.503s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 93312f50-72e0-4d65-a125-e6101ad73c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 62c8d241-26ff-431e-98de-56c2941cf895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 8ea60b55-d974-4262-9413-37459394f8a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:07:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Creating image(s)
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Ensure instance console log exists: /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Start _get_guest_xml network_info=[{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'beadcb0e-cfbb-4fca-ae82-407f2e502f36', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMaiwmKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db5b1a94-7308-4e99-bc57-025611be1f23', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec03014f-39a5-4b50-b96b-76fabf658cb0', 'serial': 'ec03014f-39a5-4b50-b96b-76fabf658cb0'}, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:07:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:07:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMaiwmKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:07:17 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:07:17 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:07:17 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc869ba1-fc4c-45ac-a3f1-a0ff1a38368f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:07:17 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1b174e-90a6-410e-8182-99ddcc6b2a70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0] added
Nov 28 14:07:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.123s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c8a6d3-31da-41e8-96fd-f656332175ce]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe4b55f-f327-422a-8583-3eefde11d9a4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMaiwmKb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMaiwmKb" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de9b866-1a65-4343-be16-ddcfebbbbb10]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nMaiwmKb'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdf6d53-102b-45d1-b19d-5602d5bf57ec]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f8dd7f-5f7d-4385-be50-1560eaf85ced]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:07:17 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:07:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:07:17 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:07:17 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:07:17 user nova-compute[75453]: 
Nov 28 14:07:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc06c238-e1c7-400d-8938-40526a6d5455]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0, portal: 172.16.0.220,3260]
Nov 28 14:07:18 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0, portal: 172.16.0.220,3260] successful.
Nov 28 14:07:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[213926f1-e688-4186-a1fd-da529813d4e6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a522ff4-433d-420e-a03a-688168686837]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:07:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:07:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d51583-6273-4764-95f0-03cd7a0a6687]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMaiwmKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26438613935383539', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438613935383539', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1272274120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1272274120',id=32,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-qjub5cqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:07:05Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=db5b1a94-7308-4e99-bc57-025611be1f23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=f6df96a1-9fa2-447c-b0f6-9f53f1521839,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6df96a1-9f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.objects.instance [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'pci_devices' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:07:19 user nova-compute[75453]:   <uuid>db5b1a94-7308-4e99-bc57-025611be1f23</uuid>
Nov 28 14:07:19 user nova-compute[75453]:   <name>instance-00000020</name>
Nov 28 14:07:19 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:07:19 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:07:19 user nova-compute[75453]:   <metadata>
Nov 28 14:07:19 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:07:19 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:07:19 user nova-compute[75453]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1272274120</nova:name>
Nov 28 14:07:19 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:07:17</nova:creationTime>
Nov 28 14:07:19 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:07:19 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:07:19 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:07:19 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:07:19 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:07:19 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:07:19 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:07:19 user nova-compute[75453]:       <nova:owner>
Nov 28 14:07:19 user nova-compute[75453]:         <nova:user uuid="f88c92554f0f44b0be661aa40aec8670">tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member</nova:user>
Nov 28 14:07:19 user nova-compute[75453]:         <nova:project uuid="3de3b398da714d8cb92fad7f64d5c64e">tempest-ServerBootFromVolumeStableRescueTest-682344680</nova:project>
Nov 28 14:07:19 user nova-compute[75453]:       </nova:owner>
Nov 28 14:07:19 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:07:19 user nova-compute[75453]:       <nova:ports>
Nov 28 14:07:19 user nova-compute[75453]:         <nova:port uuid="f6df96a1-9fa2-447c-b0f6-9f53f1521839">
Nov 28 14:07:19 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 14:07:19 user nova-compute[75453]:         </nova:port>
Nov 28 14:07:19 user nova-compute[75453]:       </nova:ports>
Nov 28 14:07:19 user nova-compute[75453]:     </nova:instance>
Nov 28 14:07:19 user nova-compute[75453]:   </metadata>
Nov 28 14:07:19 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:07:19 user nova-compute[75453]:     <system>
Nov 28 14:07:19 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:07:19 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:07:19 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:07:19 user nova-compute[75453]:       <entry name="serial">db5b1a94-7308-4e99-bc57-025611be1f23</entry>
Nov 28 14:07:19 user nova-compute[75453]:       <entry name="uuid">db5b1a94-7308-4e99-bc57-025611be1f23</entry>
Nov 28 14:07:19 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:07:19 user nova-compute[75453]:     </system>
Nov 28 14:07:19 user nova-compute[75453]:   </sysinfo>
Nov 28 14:07:19 user nova-compute[75453]:   <os>
Nov 28 14:07:19 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:07:19 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:07:19 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:07:19 user nova-compute[75453]:   </os>
Nov 28 14:07:19 user nova-compute[75453]:   <features>
Nov 28 14:07:19 user nova-compute[75453]:     <acpi/>
Nov 28 14:07:19 user nova-compute[75453]:     <apic/>
Nov 28 14:07:19 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:07:19 user nova-compute[75453]:   </features>
Nov 28 14:07:19 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:07:19 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:07:19 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:07:19 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:07:19 user nova-compute[75453]:   </clock>
Nov 28 14:07:19 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:07:19 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:07:19 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:07:19 user nova-compute[75453]:   </cpu>
Nov 28 14:07:19 user nova-compute[75453]:   <devices>
Nov 28 14:07:19 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:07:19 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:07:19 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:07:19 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:07:19 user nova-compute[75453]:       <serial>ec03014f-39a5-4b50-b96b-76fabf658cb0</serial>
Nov 28 14:07:19 user nova-compute[75453]:     </disk>
Nov 28 14:07:19 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:07:19 user nova-compute[75453]:       <mac address="fa:16:3e:f5:2b:72"/>
Nov 28 14:07:19 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:07:19 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:07:19 user nova-compute[75453]:       <target dev="tapf6df96a1-9f"/>
Nov 28 14:07:19 user nova-compute[75453]:     </interface>
Nov 28 14:07:19 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:07:19 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/console.log" append="off"/>
Nov 28 14:07:19 user nova-compute[75453]:     </serial>
Nov 28 14:07:19 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:07:19 user nova-compute[75453]:     <video>
Nov 28 14:07:19 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:07:19 user nova-compute[75453]:     </video>
Nov 28 14:07:19 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:07:19 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:07:19 user nova-compute[75453]:     </rng>
Nov 28 14:07:19 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:07:19 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:07:19 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:07:19 user nova-compute[75453]:     </memballoon>
Nov 28 14:07:19 user nova-compute[75453]:   </devices>
Nov 28 14:07:19 user nova-compute[75453]: </domain>
Nov 28 14:07:19 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1272274120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1272274120',id=32,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-qjub5cqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:07:05Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=db5b1a94-7308-4e99-bc57-025611be1f23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=f6df96a1-9fa2-447c-b0f6-9f53f1521839,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6df96a1-9f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG os_vif [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=f6df96a1-9fa2-447c-b0f6-9f53f1521839,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6df96a1-9f') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '819a38a5-184e-524b-a8af-3f7d27a2d63e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6df96a1-9f, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6df96a1-9f, col_values=(('qos', UUID('d6ab7e64-6ed7-40e3-8521-60df620ddd12')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6df96a1-9f, col_values=(('external_ids', {'iface-id': 'f6df96a1-9fa2-447c-b0f6-9f53f1521839', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:2b:72', 'vm-uuid': 'db5b1a94-7308-4e99-bc57-025611be1f23'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:19 user nova-compute[75453]: INFO os_vif [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=f6df96a1-9fa2-447c-b0f6-9f53f1521839,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6df96a1-9f')
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:07:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No VIF found with MAC fa:16:3e:f5:2b:72, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:07:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:07:21 user nova-compute[75453]: WARNING nova.compute.manager [req-7417fd06-67b2-496c-8607-0c91adaa585f req-955c00f0-49d6-42f7-ab6c-6fbc01a00084 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state building and task_state spawning.
Nov 28 14:07:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:07:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:07:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Instance spawned successfully.
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:07:22 user nova-compute[75453]: INFO nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 28 14:07:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:07:22 user nova-compute[75453]: INFO nova.compute.manager [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Took 18.98 seconds to build instance.
Nov 28 14:07:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcac574e-8c2f-4a5c-bfbd-429b74998d27 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "db5b1a94-7308-4e99-bc57-025611be1f23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.106s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:07:23 user nova-compute[75453]: WARNING nova.compute.manager [req-b56eda8a-badf-4417-bacb-1a79baf2376a req-df8a717d-5b02-4f0a-9735-568eaa4a2f99 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state active and task_state None.
Nov 28 14:07:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received event network-changed-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Refreshing instance network info cache due to event network-changed-26578bc1-9515-4ec1-a156-a2a6de8681cf. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:07:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] Acquiring lock "refresh_cache-2c994fe4-2ec9-497f-9069-1fbbfafa3410" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:07:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] Acquired lock "refresh_cache-2c994fe4-2ec9-497f-9069-1fbbfafa3410" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:07:42 user nova-compute[75453]: DEBUG nova.network.neutron [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Refreshing network info cache for port 26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:07:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:42 user nova-compute[75453]: DEBUG nova.network.neutron [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Updated VIF entry in instance network info cache for port 26578bc1-9515-4ec1-a156-a2a6de8681cf. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:07:42 user nova-compute[75453]: DEBUG nova.network.neutron [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Updating instance_info_cache with network_info: [{"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c3077cd6-4e9c-4c3a-9bf2-1514448df4d3 req-3e923f9b-800b-46c6-9b23-0b77fcb4086a service nova] Releasing lock "refresh_cache-2c994fe4-2ec9-497f-9069-1fbbfafa3410" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:07:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'flavor' on Instance uuid 2c994fe4-2ec9-497f-9069-1fbbfafa3410 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:45 user nova-compute[75453]: INFO nova.compute.manager [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Attaching volume fcfdd796-6e32-4d42-8d36-7b15bba7360f to /dev/vdb
Nov 28 14:07:45 user nova-compute[75453]: DEBUG os_brick.utils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eac6003-8afb-4114-ac3b-e6f2d27d59cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d81099-2c90-4f2b-b949-52ea7f2b88a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f836b-1aac-41ab-905c-f20ff0892629]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fb9170-33d7-4ede-83cd-10c13db23423]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:07:45 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:07:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a7cd7c-2dbf-4ca1-8656-c75330c25e05]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG os_brick.utils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:07:45 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Updating existing volume attachment record: ac45fc74-9a20-485c-9bb5-ab0d815241b8 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "93312f50-72e0-4d65-a125-e6101ad73c91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "93312f50-72e0-4d65-a125-e6101ad73c91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:47 user nova-compute[75453]: INFO nova.compute.manager [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Terminating instance
Nov 28 14:07:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received event network-vif-unplugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] Acquiring lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] No waiting events found dispatching network-vif-unplugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-90a2be27-9e44-4ae4-bd46-d47bf1ae4454 req-c267e72f-65c1-4ba6-bdc7-24ec6935015d service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received event network-vif-unplugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:07:48 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Instance destroyed successfully.
Nov 28 14:07:48 user nova-compute[75453]: DEBUG nova.objects.instance [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lazy-loading 'resources' on Instance uuid 93312f50-72e0-4d65-a125-e6101ad73c91 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-732089374',display_name='tempest-VolumesActionsTest-instance-732089374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-732089374',id=25,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:06:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70e6f2f181214fa494ee8b5ca7eaad86',ramdisk_id='',reservation_id='r-vpym5845',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-59909644',owner_user_name='tempest-VolumesActionsTest-59909644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:06:01Z,user_data=None,user_id='02461b60e13a4db999369d87c2e426e8',uuid=93312f50-72e0-4d65-a125-e6101ad73c91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Converting VIF {"id": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "address": "fa:16:3e:8c:cf:70", "network": {"id": "6ab99829-a69e-4d03-a12d-572a7d42564a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995853847-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70e6f2f181214fa494ee8b5ca7eaad86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapead8790b-5e", "ovs_interfaceid": "ead8790b-5e34-4c7d-a8af-a4a121fd03ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cf:70,bridge_name='br-int',has_traffic_filtering=True,id=ead8790b-5e34-4c7d-a8af-a4a121fd03ac,network=Network(6ab99829-a69e-4d03-a12d-572a7d42564a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapead8790b-5e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG os_vif [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cf:70,bridge_name='br-int',has_traffic_filtering=True,id=ead8790b-5e34-4c7d-a8af-a4a121fd03ac,network=Network(6ab99829-a69e-4d03-a12d-572a7d42564a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapead8790b-5e') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapead8790b-5e, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=437a8bd2-1a1d-415a-85cb-b439477df7cd) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:48 user nova-compute[75453]: INFO os_vif [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cf:70,bridge_name='br-int',has_traffic_filtering=True,id=ead8790b-5e34-4c7d-a8af-a4a121fd03ac,network=Network(6ab99829-a69e-4d03-a12d-572a7d42564a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapead8790b-5e')
Nov 28 14:07:48 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Deleting instance files /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91_del
Nov 28 14:07:48 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Deletion of /opt/stack/data/nova/instances/93312f50-72e0-4d65-a125-e6101ad73c91_del complete
Nov 28 14:07:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:48 user nova-compute[75453]: INFO nova.compute.manager [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 28 14:07:48 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:07:48 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:07:49 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:49 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Took 0.71 seconds to deallocate network for instance.
Nov 28 14:07:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received event network-vif-deleted-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:49 user nova-compute[75453]: INFO nova.compute.manager [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Neutron deleted interface ead8790b-5e34-4c7d-a8af-a4a121fd03ac; detaching it from the instance and deleting it from the info cache
Nov 28 14:07:49 user nova-compute[75453]: DEBUG nova.network.neutron [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-6a8b440a-4b40-4047-b972-f42935235e92 req-118da770-b089-41ea-bf7c-3d1bff924e59 service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Detach interface failed, port_id=ead8790b-5e34-4c7d-a8af-a4a121fd03ac, reason: Instance 93312f50-72e0-4d65-a125-e6101ad73c91 could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 14:07:49 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:07:49 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:07:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:49 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Deleted allocations for instance 93312f50-72e0-4d65-a125-e6101ad73c91
Nov 28 14:07:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bbc3fda5-d363-4fc0-8cd7-89eb4e1e24ff tempest-VolumesActionsTest-59909644 tempest-VolumesActionsTest-59909644-project-member] Lock "93312f50-72e0-4d65-a125-e6101ad73c91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.005s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received event network-vif-plugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] Acquiring lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] Lock "93312f50-72e0-4d65-a125-e6101ad73c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] No waiting events found dispatching network-vif-plugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:07:50 user nova-compute[75453]: WARNING nova.compute.manager [req-43acf06a-b0fd-40e0-a63c-5b28264ff78b req-d8fb9d57-8fb7-4d80-8689-4a58e4fd5edf service nova] [instance: 93312f50-72e0-4d65-a125-e6101ad73c91] Received unexpected event network-vif-plugged-ead8790b-5e34-4c7d-a8af-a4a121fd03ac for instance with vm_state deleted and task_state None.
Nov 28 14:07:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOILUyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:07:52 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:07:52 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:07:52 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f3c8c1-c9aa-4825-b349-67a8dc5782b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:07:52 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09bcc5f-c737-4c26-b4f3-91b0595619b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f] added
Nov 28 14:07:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd51e5da-15b9-404c-bd44-92108daa9c49]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[be43068f-4498-4cb7-a761-0109cd5d8567]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaOILUyK {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaOILUyK" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daff0ad-563c-432b-8073-9567801853aa]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaOILUyK'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[95caecbb-0e75-47c5-9007-ee6619f1270d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47dd703-2be9-498b-b1fe-01e3540bd888]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:07:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:07:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[25629b6f-af2c-4ecc-a746-2670960243c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f, portal: 172.16.0.220,3260]
Nov 28 14:07:52 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f, portal: 172.16.0.220,3260] successful.
Nov 28 14:07:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b656274-bfdb-4013-bb1d-6304d9530e4b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[742afe81-c987-4adc-8c30-802a398207bf]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:07:52 user nova-compute[75453]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)
Nov 28 14:07:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:07:52 user nova-compute[75453]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)
Nov 28 14:07:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e964866-038e-40d0-8253-fc1e2cc3e0d1]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOILUyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:07:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:07:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23563306362383163', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:07:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563306362383163', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:07:53 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'flavor' on Instance uuid 2c994fe4-2ec9-497f-9069-1fbbfafa3410 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:07:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:07:53 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:07:53 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:07:53 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:07:53 user nova-compute[75453]:   <serial>fcfdd796-6e32-4d42-8d36-7b15bba7360f</serial>
Nov 28 14:07:53 user nova-compute[75453]: </disk>
Nov 28 14:07:53 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:07:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:07:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:07:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] No VIF found with MAC fa:16:3e:b9:bd:48, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:07:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c5fdcf8d-e9b3-4f82-85ed-38f7b983cf27 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.706s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:55 user nova-compute[75453]: INFO nova.compute.manager [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Detaching volume fcfdd796-6e32-4d42-8d36-7b15bba7360f
Nov 28 14:07:55 user nova-compute[75453]: INFO nova.virt.block_device [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Attempting to driver detach volume fcfdd796-6e32-4d42-8d36-7b15bba7360f from mountpoint /dev/vdb
Nov 28 14:07:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Attempting to detach device vdb from instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:07:55 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:07:55 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:07:55 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:07:55 user nova-compute[75453]:   <serial>fcfdd796-6e32-4d42-8d36-7b15bba7360f</serial>
Nov 28 14:07:55 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:07:55 user nova-compute[75453]: </disk>
Nov 28 14:07:55 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:07:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully detached device vdb from instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 from the persistent domain config.
Nov 28 14:07:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:07:55 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:07:55 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:07:55 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:07:55 user nova-compute[75453]:   <serial>fcfdd796-6e32-4d42-8d36-7b15bba7360f</serial>
Nov 28 14:07:55 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:07:55 user nova-compute[75453]: </disk>
Nov 28 14:07:55 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received event network-changed-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Refreshing instance network info cache due to event network-changed-fe80bff8-4392-40bb-942f-b2095b29199c. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] Acquiring lock "refresh_cache-527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] Acquired lock "refresh_cache-527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG nova.network.neutron [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Refreshing network info cache for port fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:07:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:07:56 user nova-compute[75453]: DEBUG nova.network.neutron [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Updated VIF entry in instance network info cache for port fe80bff8-4392-40bb-942f-b2095b29199c. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:07:56 user nova-compute[75453]: DEBUG nova.network.neutron [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Updating instance_info_cache with network_info: [{"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:07:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3e9890b4-8b4b-47ac-bff4-0559c2ea0958 req-c3844fd7-3fca-424e-9b3f-5637bba59206 service nova] Releasing lock "refresh_cache-527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:07:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:07:58 user nova-compute[75453]: INFO nova.compute.manager [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Attaching volume a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 to /dev/vdb
Nov 28 14:07:58 user nova-compute[75453]: DEBUG os_brick.utils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e7bbf-ffa9-4be9-9fb3-511961c34654]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e314e06-21f4-4c35-8cc8-6940b4b9f12c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a98b3a6-0fa1-4aac-ab58-6035b434ee28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdb5f71-0397-4684-aa14-149f3a99fef5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:07:58 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:07:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0f8d58-ddfe-4d87-990d-af54d242f770]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG os_brick.utils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:07:58 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Updating existing volume attachment record: da899775-74d1-4ae9-b375-dc36bc5872fc {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:08:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GixZNVpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:05 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:05 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:05 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd56e723-3b89-4211-a853-2506d2586656]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:08:05 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ffba3e-36b0-461d-874c-9f758a1d68fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4] added
Nov 28 14:08:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25d99de-960a-4e90-8f74-3a62cf11d286]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[669a48cd-5207-494b-8eaa-510d1157bc75]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GixZNVpE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GixZNVpE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e500e88-c54b-469c-8e2f-6d138605084c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GixZNVpE'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf036a7-4a18-4929-9e57-d96a5e4651f8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9139dc-968d-459e-993b-2ab542ae463f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:05 user nova-compute[75453]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)
Nov 28 14:08:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:05 user nova-compute[75453]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)
Nov 28 14:08:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e427e312-ede9-43f5-95ce-823fcfc427bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4, portal: 172.16.0.220,3260]
Nov 28 14:08:05 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a464849-2fd0-4843-a9b3-b26d3e7cb4ec]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[108a879c-2137-43d8-8f65-b2fcf6d2e8f9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:05 user nova-compute[75453]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)
Nov 28 14:08:05 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:05 user nova-compute[75453]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)
Nov 28 14:08:05 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:05 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[461976e7-2cbb-4e00-abc9-a0911a3ab260]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:05 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GixZNVpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:08:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23237656631333866', 'path': '/dev/sdd'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237656631333866', 'path': '/dev/sdd'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:08:06 user nova-compute[75453]: DEBUG nova.objects.instance [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:08:06 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:06 user nova-compute[75453]:   <source dev="/dev/sdd"/>
Nov 28 14:08:06 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:08:06 user nova-compute[75453]:   <serial>a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4</serial>
Nov 28 14:08:06 user nova-compute[75453]: </disk>
Nov 28 14:08:06 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:08:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No VIF found with MAC fa:16:3e:c1:6d:fe, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:08:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4b286ea0-b092-44ce-b523-6105b94bce15 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.819s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received event network-changed-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Refreshing instance network info cache due to event network-changed-0ba0a0df-c224-46cd-b429-d360d113d576. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:08:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] Acquiring lock "refresh_cache-bed61555-342d-46bc-95c6-4f94b8c5bbe5" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:08:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] Acquired lock "refresh_cache-bed61555-342d-46bc-95c6-4f94b8c5bbe5" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:08:09 user nova-compute[75453]: DEBUG nova.network.neutron [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Refreshing network info cache for port 0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:08:09 user nova-compute[75453]: DEBUG nova.network.neutron [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Updated VIF entry in instance network info cache for port 0ba0a0df-c224-46cd-b429-d360d113d576. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:08:09 user nova-compute[75453]: DEBUG nova.network.neutron [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Updating instance_info_cache with network_info: [{"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:08:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fb0573e0-d1a6-4919-bc43-c776a7676b8a req-97b8648d-d448-4d1f-8ddb-c6ad01b9f629 service nova] Releasing lock "refresh_cache-bed61555-342d-46bc-95c6-4f94b8c5bbe5" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG nova.objects.instance [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'flavor' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:10 user nova-compute[75453]: INFO nova.compute.manager [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Attaching volume d06aa0b6-3395-4fb7-ad77-b637fad36102 to /dev/vdb
Nov 28 14:08:10 user nova-compute[75453]: DEBUG os_brick.utils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b71a83-d525-4bc7-b4e3-14ca9fea6a33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[94149083-88ff-44b7-80e6-65ee651f97d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb64849-74ea-4fe9-bbcc-4839964dc904]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecdb094-21ab-44c0-a159-9048b1e59eab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:10 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:08:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebec37fe-4788-426d-b916-6a857b6064a4]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG os_brick.utils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:10 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Updating existing volume attachment record: 0e8def21-38ba-410a-9cad-7bd55e926f2f {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG nova.objects.instance [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:11 user nova-compute[75453]: INFO nova.compute.manager [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Attaching volume b4f3128e-03e1-4626-9cff-99ae0d0546d9 to /dev/vdc
Nov 28 14:08:11 user nova-compute[75453]: DEBUG os_brick.utils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4b0ef1-bc51-4860-9ffc-4b69716b7fd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dc035d-4d34-4412-9dc2-0615f07af78a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a44bd7a-3aaf-4165-a230-1f1c02347fa1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce8e825-bce8-46c1-88ac-a44ae51b65d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:11 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:08:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bfb0c3-a672-4f2b-9012-189612ee4ba6]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG os_brick.utils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:11 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Updating existing volume attachment record: 494a1c1d-c457-47c2-81e1-f7b8895ea74a {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:08:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:15 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 is timed out.
Nov 28 14:08:15 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully detached device vdb from instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 from the live domain config.
Nov 28 14:08:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaOILUyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:15 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb9be6-fb0e-4b17-8ce2-63cc17544f80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:08:15 user nova-compute[75453]: No targets found.
Nov 28 14:08:15 user nova-compute[75453]: iSNS:
Nov 28 14:08:15 user nova-compute[75453]: No targets found.
Nov 28 14:08:15 user nova-compute[75453]: STATIC:
Nov 28 14:08:15 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f
Nov 28 14:08:15 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:15 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:15 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:08:15 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:15 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:15 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4
Nov 28 14:08:15 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:15 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:15 user nova-compute[75453]: FIRMWARE:
Nov 28 14:08:15 user nova-compute[75453]: No targets found.
Nov 28 14:08:15 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:08:15 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:08:15 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[430e3655-0f79-4cda-b5ff-60e488c6a94c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff1605-77ca-4c04-a3fc-eecc80ca3c09]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:15 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:15 user nova-compute[75453]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)
Nov 28 14:08:15 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:15 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:16 user nova-compute[75453]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f (non-flash)
Nov 28 14:08:16 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:16 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02187769e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c6749-bfea-45cd-a3a8-d3a85a663908]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ea9f0b-9f5c-4b68-8b44-84f06927d001]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b759bb-8650-46fd-99e4-d84731bb7f1f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d2901-e9aa-4d33-ab62-af6b0c78af7c]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d626f1d-8dc9-44f0-8e3f-9df260f673e3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90ad816-789b-4309-8b61-f12ef9506492]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f, portal: 172.16.0.220,3260]
Nov 28 14:08:16 user nova-compute[75453]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:16 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfdd796-6e32-4d42-8d36-7b15bba7360f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f218a2-1522-48d6-81ab-6e73e0aaa867]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] <== disconnect_volume: return (379ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'flavor' on Instance uuid 2c994fe4-2ec9-497f-9069-1fbbfafa3410 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:08:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7727MB free_disk=25.153133392333984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e591ca4b-b725-40a6-bb35-942dd5fce488 tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.938s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 62c8d241-26ff-431e-98de-56c2941cf895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 8ea60b55-d974-4262-9413-37459394f8a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:17 user nova-compute[75453]: INFO nova.compute.manager [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Terminating instance
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHCTWyKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:17 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:17 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:17 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:08:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa577e8f-e0ed-4eff-b622-ecaaf2b63177]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:08:18 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f785be-dcb7-46c0-b76c-71b149c0fa0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102] added
Nov 28 14:08:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac20ae1a-8bd6-45a0-bc2e-42dc9f5f85ce]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5815cf60-a4ab-46ee-a1fe-ab442576235e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHCTWyKn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VHCTWyKn" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd6c303-5ffc-4984-b63f-0a4bc0217dbd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VHCTWyKn'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feec8b4-1c52-47b3-b312-6be402d4c978]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received event network-vif-unplugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] Acquiring lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] No waiting events found dispatching network-vif-unplugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-a430b8af-4f3e-41d0-b1ef-1781733d601f req-229dfd10-9734-40b1-bdca-7ba69c1eabc3 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received event network-vif-unplugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf127784-4c05-4740-ae6f-4fa710e64ae4]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcada69-6ff4-4499-8d9b-d42434fad791]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102, portal: 172.16.0.220,3260]
Nov 28 14:08:18 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Instance destroyed successfully.
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.objects.instance [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lazy-loading 'resources' on Instance uuid 85e0a0a1-9ed0-4f33-8a44-33649338b57f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1349513798',display_name='tempest-VolumesActionsTest-instance-1349513798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1349513798',id=29,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d70602cf7cc04aed9d9f010e82cd37b3',ramdisk_id='',reservation_id='r-462b0lgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1229850681',owner_user_name='tempest-VolumesActionsTest-1229850681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:06:33Z,user_data=None,user_id='e4918246c1354b6a923ed07fd6136069',uuid=85e0a0a1-9ed0-4f33-8a44-33649338b57f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converting VIF {"id": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "address": "fa:16:3e:70:7f:37", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ba0f2-28", "ovs_interfaceid": "152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:7f:37,bridge_name='br-int',has_traffic_filtering=True,id=152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ba0f2-28') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_vif [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:7f:37,bridge_name='br-int',has_traffic_filtering=True,id=152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ba0f2-28') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[af86f6ca-0c20-4bcc-942f-b4d55ba49aa3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap152ba0f2-28, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f36b5b4-09e2-4905-b8c9-79b7fbd80f2f) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:18 user nova-compute[75453]: INFO os_vif [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:7f:37,bridge_name='br-int',has_traffic_filtering=True,id=152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ba0f2-28')
Nov 28 14:08:18 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Deleting instance files /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f_del
Nov 28 14:08:18 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Deletion of /opt/stack/data/nova/instances/85e0a0a1-9ed0-4f33-8a44-33649338b57f_del complete
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[624c6966-b493-4365-af0d-ae1795ae152a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec250795-e8bc-47ef-819f-0fc3af3217c8]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHCTWyKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:08:18 user nova-compute[75453]: INFO nova.compute.manager [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKpCZayg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:18 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:18 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:08:18 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Took 0.51 seconds to deallocate network for instance.
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26637613563316332', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637613563316332', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.616s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:19 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:19 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG nova.objects.instance [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'flavor' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:19 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Deleted allocations for instance 85e0a0a1-9ed0-4f33-8a44-33649338b57f
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1bebbe-7216-4e2f-94bf-e07ba0414e8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:08:19 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:08:19 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:19 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:08:19 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:08:19 user nova-compute[75453]:   <serial>d06aa0b6-3395-4fb7-ad77-b637fad36102</serial>
Nov 28 14:08:19 user nova-compute[75453]: </disk>
Nov 28 14:08:19 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3344c13-6c2f-4d38-8b1b-a69328d2306a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9] added
Nov 28 14:08:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99a86f5-329b-4963-9f7a-b07eae3702fa]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.148s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[577cca41-f2cb-4dfc-93cf-f1e02c21a4ef]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKpCZayg {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-80172766-0399-4a53-831c-0d80f6e749b5 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKpCZayg" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea74f47a-c111-4a22-9fcc-89d4a43ae7bd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HKpCZayg'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa17c66-33ba-42c8-9b74-7d5be952b82e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd529344-ae04-489f-ae24-35cb9cb3aa69]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bc3e5f-55d7-4b8b-96ea-45dad8e4d23f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9, portal: 172.16.0.220,3260]
Nov 28 14:08:19 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0ad126-b6be-4160-b99a-028e9a0401cb]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cd956c-244e-48f7-bd63-6413b85da1ca]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ab196-2227-49e1-a2d5-58f1aa85fe90]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKpCZayg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] No VIF found with MAC fa:16:3e:a5:78:ca, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4ceff234-d704-42dc-812d-77753cce91dc tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.773s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received event network-vif-plugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] Acquiring lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] Lock "85e0a0a1-9ed0-4f33-8a44-33649338b57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] No waiting events found dispatching network-vif-plugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:08:20 user nova-compute[75453]: WARNING nova.compute.manager [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received unexpected event network-vif-plugged-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc for instance with vm_state deleted and task_state None.
Nov 28 14:08:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a676338f-b471-4845-8b8a-44a40fa27cd7 req-3d1d37bd-12a0-42c6-a27f-e68b783e5073 service nova] [instance: 85e0a0a1-9ed0-4f33-8a44-33649338b57f] Received event network-vif-deleted-152ba0f2-28aa-4cc7-a1f3-87abaa6cb4cc {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== connect_volume: return (2095ms) {'type': 'block', 'scsi_wwn': '23865383563333535', 'path': '/dev/sde'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865383563333535', 'path': '/dev/sde'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG nova.objects.instance [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:08:20 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:20 user nova-compute[75453]:   <source dev="/dev/sde"/>
Nov 28 14:08:20 user nova-compute[75453]:   <target dev="vdc" bus="virtio"/>
Nov 28 14:08:20 user nova-compute[75453]:   <serial>b4f3128e-03e1-4626-9cff-99ae0d0546d9</serial>
Nov 28 14:08:20 user nova-compute[75453]: </disk>
Nov 28 14:08:20 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:08:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] No VIF found with MAC fa:16:3e:c1:6d:fe, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:08:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c3154a6-b614-41e3-8cf7-f000c9108b7b tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.214s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:22 user nova-compute[75453]: INFO nova.compute.manager [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Detaching volume a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4
Nov 28 14:08:22 user nova-compute[75453]: INFO nova.virt.block_device [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Attempting to driver detach volume a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 from mountpoint /dev/vdb
Nov 28 14:08:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Attempting to detach device vdb from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:08:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:08:22 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:22 user nova-compute[75453]:   <source dev="/dev/sdd"/>
Nov 28 14:08:22 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:08:22 user nova-compute[75453]:   <serial>a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4</serial>
Nov 28 14:08:22 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:08:22 user nova-compute[75453]: </disk>
Nov 28 14:08:22 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:08:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully detached device vdb from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c from the persistent domain config.
Nov 28 14:08:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:08:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:08:22 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:22 user nova-compute[75453]:   <source dev="/dev/sdd"/>
Nov 28 14:08:22 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:08:22 user nova-compute[75453]:   <serial>a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4</serial>
Nov 28 14:08:22 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:08:22 user nova-compute[75453]: </disk>
Nov 28 14:08:22 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:08:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:08:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:23 user nova-compute[75453]: DEBUG nova.objects.instance [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'flavor' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:24 user nova-compute[75453]: INFO nova.compute.manager [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Attaching volume f244b423-f355-4580-8bd2-7c56e8311902 to /dev/vdc
Nov 28 14:08:24 user nova-compute[75453]: DEBUG os_brick.utils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472cb1f-4b54-4723-878d-37ad8d95f283]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbe4f3d-b2a9-45ef-8153-ed2143d8fab2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde9529a-4771-4c91-84d0-7889da9a19d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[21143104-bb03-4f69-9911-1d01acee15a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:24 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:08:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8513d1-6b22-4d5d-9c09-5aa3a0b7541a]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG os_brick.utils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:24 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Updating existing volume attachment record: 8ef89f8b-7d16-42cc-93b8-bcfa71798d96 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:08:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-changed-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Refreshing instance network info cache due to event network-changed-90875e2b-ad20-4e71-903c-08ab27b78d96. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:08:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] Acquiring lock "refresh_cache-62c8d241-26ff-431e-98de-56c2941cf895" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:08:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] Acquired lock "refresh_cache-62c8d241-26ff-431e-98de-56c2941cf895" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:08:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Refreshing network info cache for port 90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:08:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Updated VIF entry in instance network info cache for port 90875e2b-ad20-4e71-903c-08ab27b78d96. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:08:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Updating instance_info_cache with network_info: [{"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:08:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-111fd9c9-4a89-43c6-8ae1-3173e5dcb431 req-92f6a621-cb4e-4909-bf83-13eb9e635191 service nova] Releasing lock "refresh_cache-62c8d241-26ff-431e-98de-56c2941cf895" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:08:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:30 user nova-compute[75453]: DEBUG nova.objects.instance [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'flavor' on Instance uuid 62c8d241-26ff-431e-98de-56c2941cf895 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:30 user nova-compute[75453]: INFO nova.compute.manager [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Attaching volume 38b03b35-b011-46d4-ab6f-2bd994f14c47 to /dev/vdb
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.utils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a7b0ce-9d60-4147-9f4c-d789fbbfc41a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1205df5-c057-4f86-8223-abf1b39cc287]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d9900-c99e-4fed-9801-f9684d044e06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c739d2-cdca-42fe-a4a7-1827c38144be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:31 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fca6e8-31a4-43a7-bfde-99dad7b106d8]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.utils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Updating existing volume attachment record: e969059a-c75a-47da-8878-75a6fd3013dd {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZKtoUil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:31 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:31 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:31 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f9dde6-d3aa-475c-84a3-5c4fc7a24332]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:08:31 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b4acf4-4884-4f11-aa1c-f7f57c3394e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902] added
Nov 28 14:08:31 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a594a1bc-f8f2-442b-a5c8-d13e05b91990]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[375db20c-823e-4dc9-ad47-cf05858391cf]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZKtoUil {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZKtoUil" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[83138f33-66ed-4160-9d61-fec72fdfb323]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DZKtoUil'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcb64aa-188e-4e50-8ba2-0ea849c0cebd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0246fdb1-fd88-4896-8785-c3fe9932925a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[932cac42-1fbf-41cd-9379-54e9ec28cfbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902, portal: 172.16.0.220,3260]
Nov 28 14:08:32 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:32 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5311c1b2-46e8-4fc2-8e03-c8b4e8686d50]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fe74a0-d9dc-4ab5-af97-60b015ac000d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:32 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[383bc145-8e80-45e8-ba1e-ec3611881c20]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZKtoUil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23536613839373862', 'path': '/dev/sdg'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536613839373862', 'path': '/dev/sdg'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG nova.objects.instance [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'flavor' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:08:33 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:33 user nova-compute[75453]:   <source dev="/dev/sdg"/>
Nov 28 14:08:33 user nova-compute[75453]:   <target dev="vdc" bus="virtio"/>
Nov 28 14:08:33 user nova-compute[75453]:   <serial>f244b423-f355-4580-8bd2-7c56e8311902</serial>
Nov 28 14:08:33 user nova-compute[75453]: </disk>
Nov 28 14:08:33 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] No VIF found with MAC fa:16:3e:a5:78:ca, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:08:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a0534b21-452d-429f-82d6-013ae5ecfcb6 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.680s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:35 user nova-compute[75453]: INFO nova.compute.manager [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Detaching volume f244b423-f355-4580-8bd2-7c56e8311902
Nov 28 14:08:35 user nova-compute[75453]: INFO nova.virt.block_device [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Attempting to driver detach volume f244b423-f355-4580-8bd2-7c56e8311902 from mountpoint /dev/vdc
Nov 28 14:08:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Attempting to detach device vdc from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:08:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:08:35 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:35 user nova-compute[75453]:   <source dev="/dev/sdg"/>
Nov 28 14:08:35 user nova-compute[75453]:   <target dev="vdc" bus="virtio"/>
Nov 28 14:08:35 user nova-compute[75453]:   <serial>f244b423-f355-4580-8bd2-7c56e8311902</serial>
Nov 28 14:08:35 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 14:08:35 user nova-compute[75453]: </disk>
Nov 28 14:08:35 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:08:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Successfully detached device vdc from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 from the persistent domain config.
Nov 28 14:08:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:08:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:08:35 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:35 user nova-compute[75453]:   <source dev="/dev/sdg"/>
Nov 28 14:08:35 user nova-compute[75453]:   <target dev="vdc" bus="virtio"/>
Nov 28 14:08:35 user nova-compute[75453]:   <serial>f244b423-f355-4580-8bd2-7c56e8311902</serial>
Nov 28 14:08:35 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 14:08:35 user nova-compute[75453]: </disk>
Nov 28 14:08:35 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:08:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:08:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:36 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'flavor' on Instance uuid 8ea60b55-d974-4262-9413-37459394f8a6 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:36 user nova-compute[75453]: INFO nova.compute.manager [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Attaching volume e61c9a94-0cbd-4b8c-99e1-eb121cf304a4 to /dev/vdb
Nov 28 14:08:37 user nova-compute[75453]: DEBUG os_brick.utils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[73896ef1-fd69-4fe8-82a7-75af546c544e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[508d52c6-1106-47a9-9c5b-26756e30db7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f8fee-cdb0-4af2-97bf-cd1488d63db0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[067ace58-f17b-4bb7-839b-62992817befa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:37 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:08:37 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8761cc9b-0ca2-4768-8fe7-bbde1fff7d90]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG os_brick.utils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Updating existing volume attachment record: b0438bee-2f0a-4d58-8ef5-5712a866d0ae {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:08:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCtsVrbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:38 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:38 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:38 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc65d939-2754-4c19-ad0b-1242cf790a82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:08:38 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c818365-ab4e-44c2-a557-05d42241ed31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47] added
Nov 28 14:08:38 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b42d9-e0dd-46ea-9aad-67c3fa3136c3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4217e78c-1e38-4f1f-9abe-181208159305]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wCtsVrbS {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wCtsVrbS" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6070ad20-0f6f-4b88-a4aa-ef0159f2e258]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wCtsVrbS'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[388f0d59-d6cc-47d7-89cc-3beb6f7524fb]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d01496-0bc5-4310-9178-5b3d3639b78a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1f2b6-453d-46af-9f74-1fb8f6cf519a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260]
Nov 28 14:08:39 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d812a2-c2fc-4631-8d7c-b0fbaeda5ec2]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[451c4043-f118-42c2-9bdf-dc234ed3818e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] HCTL ('39', '-', '-', 0) found on session 38 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae8e66b-4e2e-4389-a490-c16e0c477436]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching for a device in session 38 and hctl ['39', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching for a device in session 38 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCtsVrbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26637393036363862', 'path': '/dev/sdh'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637393036363862', 'path': '/dev/sdh'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG nova.objects.instance [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'flavor' on Instance uuid 62c8d241-26ff-431e-98de-56c2941cf895 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:08:40 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:40 user nova-compute[75453]:   <source dev="/dev/sdh"/>
Nov 28 14:08:40 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:08:40 user nova-compute[75453]:   <serial>38b03b35-b011-46d4-ab6f-2bd994f14c47</serial>
Nov 28 14:08:40 user nova-compute[75453]: </disk>
Nov 28 14:08:40 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No VIF found with MAC fa:16:3e:1f:0b:54, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:08:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-82e0f994-ad35-4e44-a3e8-0fe8b8657b36 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.853s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:42 user nova-compute[75453]: INFO nova.compute.manager [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Rebuilding instance
Nov 28 14:08:42 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c is timed out.
Nov 28 14:08:42 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully detached device vdb from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c from the live domain config.
Nov 28 14:08:42 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GixZNVpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:42 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1376a68a-5ca9-4df3-b128-3b0ed323ec33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:08:42 user nova-compute[75453]: No targets found.
Nov 28 14:08:42 user nova-compute[75453]: iSNS:
Nov 28 14:08:42 user nova-compute[75453]: No targets found.
Nov 28 14:08:42 user nova-compute[75453]: STATIC:
Nov 28 14:08:42 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902
Nov 28 14:08:42 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:42 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:42 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399
Nov 28 14:08:42 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:42 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:42 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47
Nov 28 14:08:42 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:42 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:42 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9
Nov 28 14:08:42 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:42 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:42 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102
Nov 28 14:08:42 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:42 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:42 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:08:42 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:42 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:42 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9
Nov 28 14:08:42 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:42 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:42 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4
Nov 28 14:08:42 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:42 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:42 user nova-compute[75453]: FIRMWARE:
Nov 28 14:08:42 user nova-compute[75453]: No targets found.
Nov 28 14:08:42 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:08:42 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:08:42 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[366101f8-296c-4e94-a204-1479bafe895d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG nova.compute.manager [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[26783425-3ae7-4501-8607-e9ef59503f5e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9 (non-flash)
Nov 28 14:08:42 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0218713c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4'): ({'sdd'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Removing single pathed devices sdd {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a7e91-6d70-41de-8938-f4d3b688687d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[991c9619-afc3-478c-be9d-cccd71063ed5]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flushing IO for device /dev/sdd {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[643c44b2-bb14-45f9-8120-b84efd3852a4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:08:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.148s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4358b17-a361-424d-be67-ed696d76ed77]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[08952152-a89e-47cb-b7f2-6fce85efaed8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c3acc4-e52c-4521-ad3e-fe3f57cce35c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4, portal: 172.16.0.220,3260]
Nov 28 14:08:43 user nova-compute[75453]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:43 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG nova.compute.manager [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-unplugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG nova.compute.manager [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-unplugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:08:43 user nova-compute[75453]: WARNING nova.compute.manager [req-cf90fac8-2bb8-437b-be50-5cdf9b40e53c req-2920a8f7-99f4-47af-8096-ab2ab2c292b6 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-unplugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state active and task_state rebuilding.
Nov 28 14:08:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a94b91-3680-4bc5-ad6b-ea30f32e3fe4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[254a3b6b-20df-476e-8efe-42c6c72997b4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.552s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== disconnect_volume: return (554ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Instance destroyed successfully.
Nov 28 14:08:43 user nova-compute[75453]: INFO nova.compute.manager [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Detaching volume 38b03b35-b011-46d4-ab6f-2bd994f14c47
Nov 28 14:08:43 user nova-compute[75453]: INFO nova.virt.block_device [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Attempting to driver detach volume 38b03b35-b011-46d4-ab6f-2bd994f14c47 from mountpoint /dev/vdb
Nov 28 14:08:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Attempting to detach device vdb from instance 62c8d241-26ff-431e-98de-56c2941cf895 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:08:43 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:43 user nova-compute[75453]:   <source dev="/dev/sdh"/>
Nov 28 14:08:43 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:08:43 user nova-compute[75453]:   <serial>38b03b35-b011-46d4-ab6f-2bd994f14c47</serial>
Nov 28 14:08:43 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:08:43 user nova-compute[75453]: </disk>
Nov 28 14:08:43 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:08:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully detached device vdb from instance 62c8d241-26ff-431e-98de-56c2941cf895 from the persistent domain config.
Nov 28 14:08:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCtsVrbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:43 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c717937b-a835-44eb-80dc-29d4eead1ca6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:08:43 user nova-compute[75453]: No targets found.
Nov 28 14:08:43 user nova-compute[75453]: iSNS:
Nov 28 14:08:43 user nova-compute[75453]: No targets found.
Nov 28 14:08:43 user nova-compute[75453]: STATIC:
Nov 28 14:08:43 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902
Nov 28 14:08:43 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:43 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:43 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399
Nov 28 14:08:43 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:43 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:43 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47
Nov 28 14:08:43 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:43 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:43 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9
Nov 28 14:08:43 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:43 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:43 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102
Nov 28 14:08:43 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:43 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:43 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:08:43 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:43 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:43 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9
Nov 28 14:08:43 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:43 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:43 user nova-compute[75453]: FIRMWARE:
Nov 28 14:08:43 user nova-compute[75453]: No targets found.
Nov 28 14:08:43 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:08:43 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:08:43 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4856413-9c1b-42c4-9053-86561a5db56a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c268fcc-c80f-40e5-9389-8ece1fc5ddc0]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9 (non-flash)
Nov 28 14:08:44 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f024c154c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47'): ({'sdh'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Removing single pathed devices sdh {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b92bdee-2219-4b37-b03b-07248701cb90]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f330a458-b494-45c6-84fc-63bb6261be5b]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flushing IO for device /dev/sdh {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cc4a69-a39a-425f-818a-d806696ec630]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.072s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09e0bb1-e348-41bd-8210-dfe7b1062c43]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] SCSI volumes sdh have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d4ec6e-86dc-4f97-9650-054dca5c714d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG nova.objects.instance [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-0c2360d9-65e5-429a-b64f-459abbfc9235 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.179s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bb15f0-aa3c-40f9-969e-cec2d74b9b54]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260]
Nov 28 14:08:44 user nova-compute[75453]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:44 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d746e741-5c3e-48b8-8bfd-e2ea6efd4199]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== disconnect_volume: return (399ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.volume.cinder [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Update attachment failed for attachment b0438bee-2f0a-4d58-8ef5-5712a866d0ae. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-590f988c-59ba-4b56-8661-ab7e5d2b4b79) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-590f988c-59ba-4b56-8661-ab7e5d2b4b79)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Failed to attach e61c9a94-0cbd-4b8c-99e1-eb121cf304a4 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-590f988c-59ba-4b56-8661-ab7e5d2b4b79)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Traceback (most recent call last):
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     ret_val = method(obj, context, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     self._do_attach(context, instance, volume, volume_api,
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     self._volume_attach(context, volume, connector, instance,
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     connection_info = volume_api.attachment_update(
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     res = method(self, ctx, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     with excutils.save_and_reraise_exception():
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     self.force_reraise()
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     raise self.value
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     context, '3.44', skip_version_check=True).attachments.update(
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     return method.func(obj, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     resp = self._update('/attachments/%s' % id, body)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     return self._cs_request(url, 'PUT', **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     return self.request(url, method, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6]     raise exceptions.from_response(resp, body)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-590f988c-59ba-4b56-8661-ab7e5d2b4b79)
Nov 28 14:08:44 user nova-compute[75453]: ERROR nova.compute.manager [instance: 8ea60b55-d974-4262-9413-37459394f8a6] 
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.664s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server [None req-f758aac3-c8d7-4306-b399-99d81c66858c tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-590f988c-59ba-4b56-8661-ab7e5d2b4b79)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-590f988c-59ba-4b56-8661-ab7e5d2b4b79)
Nov 28 14:08:44 user nova-compute[75453]: ERROR oslo_messaging.rpc.server 
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:44 user nova-compute[75453]: INFO nova.compute.manager [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Detaching volume b4f3128e-03e1-4626-9cff-99ae0d0546d9
Nov 28 14:08:45 user nova-compute[75453]: INFO nova.virt.block_device [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Attempting to driver detach volume b4f3128e-03e1-4626-9cff-99ae0d0546d9 from mountpoint /dev/vdc
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Attempting to detach device vdc from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:08:45 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:45 user nova-compute[75453]:   <source dev="/dev/sde"/>
Nov 28 14:08:45 user nova-compute[75453]:   <target dev="vdc" bus="virtio"/>
Nov 28 14:08:45 user nova-compute[75453]:   <serial>b4f3128e-03e1-4626-9cff-99ae0d0546d9</serial>
Nov 28 14:08:45 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 14:08:45 user nova-compute[75453]: </disk>
Nov 28 14:08:45 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:08:45 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully detached device vdc from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c from the persistent domain config.
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:08:45 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:45 user nova-compute[75453]:   <source dev="/dev/sde"/>
Nov 28 14:08:45 user nova-compute[75453]:   <target dev="vdc" bus="virtio"/>
Nov 28 14:08:45 user nova-compute[75453]:   <serial>b4f3128e-03e1-4626-9cff-99ae0d0546d9</serial>
Nov 28 14:08:45 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 14:08:45 user nova-compute[75453]: </disk>
Nov 28 14:08:45 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:08:45 user nova-compute[75453]: WARNING nova.compute.manager [req-853b4fde-7241-4f49-95d1-5fa0710d4bc0 req-7232c052-ff53-4d8c-9bce-937b450bf3de service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state active and task_state rebuilding.
Nov 28 14:08:45 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Instance destroyed successfully.
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1682840901',display_name='tempest-ServerActionsTestOtherA-server-1998050807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1682840901',id=30,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXwEXKVXgWWKg7f1++x+TJXhG7IKT/xO+VHfqjWh6vTLUqjBHnnqIN9BD48DwKAR5bFvefKT51EUFBNmqbL89LQSkNMn22MOEyL4az1iMY6GaI68+ZEUNFcu40O71nmtw==',key_name='tempest-keypair-1093862542',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:06:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-gj7iwpw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=62c8d241-26ff-431e-98de-56c2941cf895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_vif [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90875e2b-ad, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=120633cc-702c-4a6a-8c1e-42093d0396e2) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:08:45 user nova-compute[75453]: INFO os_vif [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad')
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCtsVrbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:45 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e31273-8335-444b-ab0e-8ab0ae7f8d60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:08:45 user nova-compute[75453]: No targets found.
Nov 28 14:08:45 user nova-compute[75453]: iSNS:
Nov 28 14:08:45 user nova-compute[75453]: No targets found.
Nov 28 14:08:45 user nova-compute[75453]: STATIC:
Nov 28 14:08:45 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902
Nov 28 14:08:45 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:45 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:45 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399
Nov 28 14:08:45 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:45 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:45 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9
Nov 28 14:08:45 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:45 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:45 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102
Nov 28 14:08:45 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:45 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:45 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:08:45 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:45 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:45 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9
Nov 28 14:08:45 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:45 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:45 user nova-compute[75453]: FIRMWARE:
Nov 28 14:08:45 user nova-compute[75453]: No targets found.
Nov 28 14:08:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:08:45 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:08:45 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1591f999-17f5-4d85-bd53-c1ecbbe2b3b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f5ff31-5580-445a-a837-6896cac8a46c]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d59e196-2954-4e51-af7e-e42594125399 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7739ff00-be09-46ff-8abb-7c601994ecd9 (non-flash)
Nov 28 14:08:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c6f1990>, {}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Disconnecting from: [] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== disconnect_volume: return (98ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:08:45 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Deleting instance files /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895_del
Nov 28 14:08:45 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Deletion of /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895_del complete
Nov 28 14:08:45 user nova-compute[75453]: INFO nova.virt.block_device [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Booting with volume 38b03b35-b011-46d4-ab6f-2bd994f14c47 at /dev/vdb
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:45 user nova-compute[75453]: INFO nova.compute.manager [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Terminating instance
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.utils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb657944-ebe5-444e-b15d-f5023c629e85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2f7e3e-dbbd-43e8-88e5-416c01e385e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3407964-228f-4a70-8240-634635df3f49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fce0544-4a9a-440b-afd4-a41cbff2c375]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:45 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:08:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd17980d-3eac-47d8-ad44-157572f6233d]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG os_brick.utils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:45 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Updating existing volume attachment record: 24cb5708-3491-4a29-b794-2836dac58a95 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:08:46 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Instance destroyed successfully.
Nov 28 14:08:46 user nova-compute[75453]: DEBUG nova.objects.instance [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lazy-loading 'resources' on Instance uuid 2c994fe4-2ec9-497f-9069-1fbbfafa3410 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1001588883',display_name='tempest-AttachVolumeNegativeTest-server-1001588883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1001588883',id=26,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXDMolo6w7qSOXv1l6Avbf9K2hLPR2zVqVxwo4QijsQzb2s+d8Sb/i5JGKrR68loytXMx+JqlFbWuJ3sNpIxhX0BWXkTOmK/gfwSkeBfCHv9PyJdB1VxE/hnfjZJS8v0Q==',key_name='tempest-keypair-464159864',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:06:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b710669f2d5c41378e2c63765f2846ed',ramdisk_id='',reservation_id='r-90n7990m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-180653455',owner_user_name='tempest-AttachVolumeNegativeTest-180653455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:06:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afdefdd832241779d405f4763c3b37e',uuid=2c994fe4-2ec9-497f-9069-1fbbfafa3410,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converting VIF {"id": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "address": "fa:16:3e:b9:bd:48", "network": {"id": "eb697d01-87f7-4768-84bb-0e25fdf0c3e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1058773580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b710669f2d5c41378e2c63765f2846ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26578bc1-95", "ovs_interfaceid": "26578bc1-9515-4ec1-a156-a2a6de8681cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:bd:48,bridge_name='br-int',has_traffic_filtering=True,id=26578bc1-9515-4ec1-a156-a2a6de8681cf,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26578bc1-95') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG os_vif [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:bd:48,bridge_name='br-int',has_traffic_filtering=True,id=26578bc1-9515-4ec1-a156-a2a6de8681cf,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26578bc1-95') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26578bc1-95, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8441579f-688b-4e44-b8cd-f670358332b4) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:08:46 user nova-compute[75453]: INFO os_vif [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:bd:48,bridge_name='br-int',has_traffic_filtering=True,id=26578bc1-9515-4ec1-a156-a2a6de8681cf,network=Network(eb697d01-87f7-4768-84bb-0e25fdf0c3e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26578bc1-95')
Nov 28 14:08:46 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Deleting instance files /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410_del
Nov 28 14:08:46 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Deletion of /opt/stack/data/nova/instances/2c994fe4-2ec9-497f-9069-1fbbfafa3410_del complete
Nov 28 14:08:46 user nova-compute[75453]: INFO nova.compute.manager [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 14:08:46 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:08:46 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received event network-vif-unplugged-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] No waiting events found dispatching network-vif-unplugged-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received event network-vif-unplugged-26578bc1-9515-4ec1-a156-a2a6de8681cf for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received event network-vif-plugged-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Acquiring lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] No waiting events found dispatching network-vif-plugged-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:08:47 user nova-compute[75453]: WARNING nova.compute.manager [req-7221309c-c699-46a8-84c4-4d6f1f1a89a6 req-10cf4646-2137-40c6-a28d-ffe9e947211a service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received unexpected event network-vif-plugged-26578bc1-9515-4ec1-a156-a2a6de8681cf for instance with vm_state active and task_state deleting.
Nov 28 14:08:47 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:08:47 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Took 0.80 seconds to deallocate network for instance.
Nov 28 14:08:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:08:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:47 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Deleted allocations for instance 2c994fe4-2ec9-497f-9069-1fbbfafa3410
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8e9fb27b-5502-4111-b183-504e600f483e tempest-AttachVolumeNegativeTest-180653455 tempest-AttachVolumeNegativeTest-180653455-project-member] Lock "2c994fe4-2ec9-497f-9069-1fbbfafa3410" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.458s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:48 user nova-compute[75453]: INFO nova.compute.manager [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Unshelving
Nov 28 14:08:48 user nova-compute[75453]: INFO nova.virt.block_device [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Booting with volume 46ed5746-e152-40d9-b8c7-b33905d5b549 at /dev/vdc
Nov 28 14:08:48 user nova-compute[75453]: DEBUG os_brick.utils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[12772fb7-b21e-46f7-aa7c-e45b4c829da9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf005ca-3c58-4d59-bb98-7b277a7dfdd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f627fc8-5605-4a2f-ab9d-481a43c254c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfb193c-d748-4213-9cf5-f8468ad774a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:08:49 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:08:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[793dfdab-c2c2-4b54-8cd3-eca24c008c60]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG os_brick.utils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating existing volume attachment record: 5139ce68-966b-4758-a44e-decc8f65f876 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:08:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7b143af3-0c18-44d9-ad6d-5ef78e69e8bb req-59df688f-b5ee-4d3e-a55a-27a25bfb99da service nova] [instance: 2c994fe4-2ec9-497f-9069-1fbbfafa3410] Received event network-vif-deleted-26578bc1-9515-4ec1-a156-a2a6de8681cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:54 user nova-compute[75453]: INFO nova.compute.manager [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Rescuing
Nov 28 14:08:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:08:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquired lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:08:54 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:08:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:08:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Creating image(s)
Nov 28 14:08:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk 1073741824" returned: 0 in 0.092s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updating instance_info_cache with network_info: [{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Releasing lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Cannot resize image /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Ensure instance console log exists: /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Start _get_guest_xml network_info=[{"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '24cb5708-3491-4a29-b794-2836dac58a95', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCtsVrbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62c8d241-26ff-431e-98de-56c2941cf895', 'attached_at': '', 'detached_at': '', 'volume_id': '38b03b35-b011-46d4-ab6f-2bd994f14c47', 'serial': '38b03b35-b011-46d4-ab6f-2bd994f14c47'}, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:08:55 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 14:08:55 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'vcpu_model' on Instance uuid 62c8d241-26ff-431e-98de-56c2941cf895 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCtsVrbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:55 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:55 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:55 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e916202-5aff-43d5-aee2-590c3e4983bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:08:55 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[774d0ff7-9f22-489c-a7c6-3d20eeb20985]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47] added
Nov 28 14:08:55 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:55 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 is timed out.
Nov 28 14:08:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Successfully detached device vdc from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 from the live domain config.
Nov 28 14:08:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb38895-b8c0-45e5-b6ba-e26cc6a19558]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZKtoUil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:55 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c12593d-c60c-4b2e-a085-01bfa2cae630]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wCtsVrbS {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wCtsVrbS" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[740c34e5-d629-4853-bec4-b1b516209bc5]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wCtsVrbS'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae824f91-3c90-4134-b0ce-f67e78607018]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d4d12a-ed71-4105-bea7-7adb5f0d20c2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-unplugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-unplugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:08:56 user nova-compute[75453]: WARNING nova.compute.manager [req-8e07c1af-6bdb-40d9-be7b-4037a431f76d req-32e6758b-69d8-4231-aa48-993c02605a2b service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-unplugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state active and task_state rescuing.
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bab134-7fa4-458c-8ec1-82f15d70deed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260]
Nov 28 14:08:56 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dda0b3-4cc2-459d-b80f-4a04f99e7419]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea605f18-e53a-4970-9f34-d18dfbade3e6]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7a8e62-a394-43ec-af82-24727c9d5baa]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCtsVrbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:08:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Instance destroyed successfully.
Nov 28 14:08:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Attempting a stable device rescue
Nov 28 14:08:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75453) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Instance directory exists: not creating {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 14:08:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Creating image(s)
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "/opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "/opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "/opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'trusted_certs' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "297f06fb495f2ecc25bb7ec765aacc06c78eb7a5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "297f06fb495f2ecc25bb7ec765aacc06c78eb7a5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.810s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== connect_volume: return (1814ms) {'type': 'block', 'scsi_wwn': '26637393036363862', 'path': '/dev/sdd'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637393036363862', 'path': '/dev/sdd'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.719s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c0bfa9-6ffa-46ad-9371-1d9988c0642f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:08:57 user nova-compute[75453]: No targets found.
Nov 28 14:08:57 user nova-compute[75453]: iSNS:
Nov 28 14:08:57 user nova-compute[75453]: No targets found.
Nov 28 14:08:57 user nova-compute[75453]: STATIC:
Nov 28 14:08:57 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902
Nov 28 14:08:57 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:57 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:57 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47
Nov 28 14:08:57 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:57 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:57 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102
Nov 28 14:08:57 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:57 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:57 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:08:57 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:57 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:57 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9
Nov 28 14:08:57 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:08:57 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:08:57 user nova-compute[75453]: FIRMWARE:
Nov 28 14:08:57 user nova-compute[75453]: No targets found.
Nov 28 14:08:57 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:08:57 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:08:57 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1682840901',display_name='tempest-ServerActionsTestOtherA-server-1998050807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1682840901',id=30,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXwEXKVXgWWKg7f1++x+TJXhG7IKT/xO+VHfqjWh6vTLUqjBHnnqIN9BD48DwKAR5bFvefKT51EUFBNmqbL89LQSkNMn22MOEyL4az1iMY6GaI68+ZEUNFcu40O71nmtw==',key_name='tempest-keypair-1093862542',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:06:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-gj7iwpw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=62c8d241-26ff-431e-98de-56c2941cf895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:08:57 user nova-compute[75453]:   <uuid>62c8d241-26ff-431e-98de-56c2941cf895</uuid>
Nov 28 14:08:57 user nova-compute[75453]:   <name>instance-0000001e</name>
Nov 28 14:08:57 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:08:57 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:08:57 user nova-compute[75453]:   <metadata>
Nov 28 14:08:57 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:08:57 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:08:57 user nova-compute[75453]:       <nova:name>tempest-ServerActionsTestOtherA-server-1998050807</nova:name>
Nov 28 14:08:57 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:08:55</nova:creationTime>
Nov 28 14:08:57 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:08:57 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:08:57 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:08:57 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:08:57 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:08:57 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:08:57 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:08:57 user nova-compute[75453]:       <nova:owner>
Nov 28 14:08:57 user nova-compute[75453]:         <nova:user uuid="9f84ee8a311d4619b7d51c2066d4775f">tempest-ServerActionsTestOtherA-1445772683-project-member</nova:user>
Nov 28 14:08:57 user nova-compute[75453]:         <nova:project uuid="82ab030af40f43e28b5f1b7ce64c50a8">tempest-ServerActionsTestOtherA-1445772683</nova:project>
Nov 28 14:08:57 user nova-compute[75453]:       </nova:owner>
Nov 28 14:08:57 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:08:57 user nova-compute[75453]:       <nova:ports>
Nov 28 14:08:57 user nova-compute[75453]:         <nova:port uuid="90875e2b-ad20-4e71-903c-08ab27b78d96">
Nov 28 14:08:57 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:08:57 user nova-compute[75453]:         </nova:port>
Nov 28 14:08:57 user nova-compute[75453]:       </nova:ports>
Nov 28 14:08:57 user nova-compute[75453]:     </nova:instance>
Nov 28 14:08:57 user nova-compute[75453]:   </metadata>
Nov 28 14:08:57 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:08:57 user nova-compute[75453]:     <system>
Nov 28 14:08:57 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:08:57 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:08:57 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:08:57 user nova-compute[75453]:       <entry name="serial">62c8d241-26ff-431e-98de-56c2941cf895</entry>
Nov 28 14:08:57 user nova-compute[75453]:       <entry name="uuid">62c8d241-26ff-431e-98de-56c2941cf895</entry>
Nov 28 14:08:57 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:08:57 user nova-compute[75453]:     </system>
Nov 28 14:08:57 user nova-compute[75453]:   </sysinfo>
Nov 28 14:08:57 user nova-compute[75453]:   <os>
Nov 28 14:08:57 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:08:57 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:08:57 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:08:57 user nova-compute[75453]:   </os>
Nov 28 14:08:57 user nova-compute[75453]:   <features>
Nov 28 14:08:57 user nova-compute[75453]:     <acpi/>
Nov 28 14:08:57 user nova-compute[75453]:     <apic/>
Nov 28 14:08:57 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:08:57 user nova-compute[75453]:   </features>
Nov 28 14:08:57 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:08:57 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:08:57 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:08:57 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:08:57 user nova-compute[75453]:   </clock>
Nov 28 14:08:57 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:08:57 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:08:57 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:08:57 user nova-compute[75453]:   </cpu>
Nov 28 14:08:57 user nova-compute[75453]:   <devices>
Nov 28 14:08:57 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:08:57 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:08:57 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk"/>
Nov 28 14:08:57 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:08:57 user nova-compute[75453]:     </disk>
Nov 28 14:08:57 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:08:57 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:57 user nova-compute[75453]:       <source dev="/dev/sdd"/>
Nov 28 14:08:57 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 14:08:57 user nova-compute[75453]:       <serial>38b03b35-b011-46d4-ab6f-2bd994f14c47</serial>
Nov 28 14:08:57 user nova-compute[75453]:     </disk>
Nov 28 14:08:57 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:08:57 user nova-compute[75453]:       <mac address="fa:16:3e:1f:0b:54"/>
Nov 28 14:08:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:08:57 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:08:57 user nova-compute[75453]:       <target dev="tap90875e2b-ad"/>
Nov 28 14:08:57 user nova-compute[75453]:     </interface>
Nov 28 14:08:57 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:08:57 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/console.log" append="off"/>
Nov 28 14:08:57 user nova-compute[75453]:     </serial>
Nov 28 14:08:57 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:08:57 user nova-compute[75453]:     <video>
Nov 28 14:08:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:08:57 user nova-compute[75453]:     </video>
Nov 28 14:08:57 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:08:57 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:08:57 user nova-compute[75453]:     </rng>
Nov 28 14:08:57 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:08:57 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:08:57 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:08:57 user nova-compute[75453]:     </memballoon>
Nov 28 14:08:57 user nova-compute[75453]:   </devices>
Nov 28 14:08:57 user nova-compute[75453]: </domain>
Nov 28 14:08:57 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1682840901',display_name='tempest-ServerActionsTestOtherA-server-1998050807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1682840901',id=30,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXwEXKVXgWWKg7f1++x+TJXhG7IKT/xO+VHfqjWh6vTLUqjBHnnqIN9BD48DwKAR5bFvefKT51EUFBNmqbL89LQSkNMn22MOEyL4az1iMY6GaI68+ZEUNFcu40O71nmtw==',key_name='tempest-keypair-1093862542',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:06:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-gj7iwpw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=62c8d241-26ff-431e-98de-56c2941cf895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_vif [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c54d966-21b4-452a-89e8-746e9a8775df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '495b464d-26bc-5e9c-b6cc-2acd0d792591', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90875e2b-ad, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90875e2b-ad, col_values=(('qos', UUID('860944cc-eebe-4ec4-9c7d-5c639583fe00')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90875e2b-ad, col_values=(('external_ids', {'iface-id': '90875e2b-ad20-4e71-903c-08ab27b78d96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:0b:54', 'vm-uuid': '62c8d241-26ff-431e-98de-56c2941cf895'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[03907803-ab41-46a3-a2ea-cc080bd26e93]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:57 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c26a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902'): ({'sdg'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Removing single pathed devices sdg {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:57 user nova-compute[75453]: INFO os_vif [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad')
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[430c4b26-1434-4e26-b310-2341b96d38a8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.virt.images [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 585d85f4-5648-40af-8947-50dcedfdabe0 was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5.part /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef9d3b9-14f8-441e-8dec-bb4005103ebc]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Flushing IO for device /dev/sdg {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b9db7f-a6ce-4b9a-a682-3a04528a001d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No VIF found with MAC fa:16:3e:1f:0b:54, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:08:57 user nova-compute[75453]: DEBUG nova.objects.instance [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'pci_requests' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.120s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ebe998-1dd4-49dd-a666-22b695d33d95]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] SCSI volumes sdg have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'numa_topology' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4241e1-867f-411a-ab60-8175b3f118e1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:08:58 user nova-compute[75453]: INFO nova.compute.claims [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Claim successful on node user
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --logout" returned: 0 in 0.130s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[301baa1f-a68c-4cea-ada1-8fc5d8295a44]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902, portal: 172.16.0.220,3260]
Nov 28 14:08:58 user nova-compute[75453]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902, portal: 172.16.0.220,3260] successful.
Nov 28 14:08:58 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:08:58 user nova-compute[75453]: WARNING nova.compute.manager [req-25a5f58e-d531-4c68-b571-c981d8dae99f req-ca0fe8a4-7da6-46db-9572-22bf44451eb0 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state active and task_state rescuing.
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5.part /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5.converted" returned: 0 in 0.392s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f244b423-f355-4580-8bd2-7c56e8311902 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe152787-7d3b-4074-94ee-35b0e1343993]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.635s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] <== disconnect_volume: return (2354ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "297f06fb495f2ecc25bb7ec765aacc06c78eb7a5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.830s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "297f06fb495f2ecc25bb7ec765aacc06c78eb7a5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "297f06fb495f2ecc25bb7ec765aacc06c78eb7a5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.757s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5 --force-share --output=json" returned: 0 in 0.221s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5,backing_fmt=raw /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5,backing_fmt=raw /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue" returned: 0 in 0.056s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "297f06fb495f2ecc25bb7ec765aacc06c78eb7a5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'migration_context' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:58 user nova-compute[75453]: INFO nova.network.neutron [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating port d02ad480-f01f-442a-a00e-7dca16a27d3d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.objects.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<db5b1a94-7308-4e99-bc57-025611be1f23> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Start _get_guest_xml network_info=[{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "vif_mac": "fa:16:3e:f5:2b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '585d85f4-5648-40af-8947-50dcedfdabe0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'beadcb0e-cfbb-4fca-ae82-407f2e502f36', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMaiwmKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'db5b1a94-7308-4e99-bc57-025611be1f23', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec03014f-39a5-4b50-b96b-76fabf658cb0', 'serial': 'ec03014f-39a5-4b50-b96b-76fabf658cb0'}, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'resources' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.objects.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<db5b1a94-7308-4e99-bc57-025611be1f23> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'numa_topology' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.objects.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<db5b1a94-7308-4e99-bc57-025611be1f23> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:08:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:08:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'vcpu_model' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.objects.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<db5b1a94-7308-4e99-bc57-025611be1f23> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMaiwmKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:08:58 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:58 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:08:58 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c183afe7-2ad2-4f33-8ced-e8c9225ddcc5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nMaiwmKb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 14:08:58 user nova-compute[75453]: node.name = iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:08:58 user nova-compute[75453]: node.tpgt = -1
Nov 28 14:08:58 user nova-compute[75453]: node.startup = automatic
Nov 28 14:08:58 user nova-compute[75453]: node.leading_login = No
Nov 28 14:08:58 user nova-compute[75453]: iface.iscsi_ifacename = default
Nov 28 14:08:58 user nova-compute[75453]: iface.net_ifacename = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.ipaddress = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.prefix_len = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.hwaddress = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.transport_name = tcp
Nov 28 14:08:58 user nova-compute[75453]: iface.initiatorname = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.state = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.vlan_id = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.vlan_priority = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.vlan_state = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.iface_num = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.mtu = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.port = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.bootproto = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.subnet_mask = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.gateway = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.dhcp_alt_client_id = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.dhcp_dns = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.dhcp_learn_iqn = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.dhcp_vendor_id_state = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.dhcp_vendor_id = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.dhcp_slp_da = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.fragmentation = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.gratuitous_arp = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.incoming_forwarding = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.tos_state = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.tos = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.ttl = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.delayed_ack = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.tcp_nagle = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.tcp_wsf_state = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.tcp_wsf = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.tcp_timer_scale = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.tcp_timestamp = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.redirect = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.def_task_mgmt_timeout = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.header_digest = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.data_digest = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.immediate_data = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.initial_r2t = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.data_seq_inorder = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.data_pdu_inorder = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.erl = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.max_receive_data_len = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.first_burst_len = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.max_outstanding_r2t = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.max_burst_len = 0
Nov 28 14:08:58 user nova-compute[75453]: iface.chap_auth = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.bidi_chap = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.strict_login_compliance = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.discovery_auth = <empty>
Nov 28 14:08:58 user nova-compute[75453]: iface.discovery_logout = <empty>
Nov 28 14:08:58 user nova-compute[75453]: node.discovery_address = <empty>
Nov 28 14:08:58 user nova-compute[75453]: node.discovery_port = 0
Nov 28 14:08:58 user nova-compute[75453]: node.discovery_type = static
Nov 28 14:08:58 user nova-compute[75453]: node.session.initial_cmdsn = 0
Nov 28 14:08:58 user nova-compute[75453]: node.session.initial_login_retry_max = 8
Nov 28 14:08:58 user nova-compute[75453]: node.session.xmit_thread_priority = -20
Nov 28 14:08:58 user nova-compute[75453]: node.session.cmds_max = 128
Nov 28 14:08:58 user nova-compute[75453]: node.session.queue_depth = 32
Nov 28 14:08:58 user nova-compute[75453]: node.session.nr_sessions = 1
Nov 28 14:08:58 user nova-compute[75453]: node.session.auth.authmethod = CHAP
Nov 28 14:08:58 user nova-compute[75453]: node.session.auth.username = nMaiwmKb
Nov 28 14:08:58 user nova-compute[75453]: node.session.auth.password = ***
Nov 28 14:08:58 user nova-compute[75453]: node.session.auth.username_in = <empty>
Nov 28 14:08:58 user nova-compute[75453]: node.session.auth.password_in = <empty>
Nov 28 14:08:58 user nova-compute[75453]: node.session.auth.chap_algs = MD5
Nov 28 14:08:58 user nova-compute[75453]: node.session.timeo.replacement_timeout = 120
Nov 28 14:08:58 user nova-compute[75453]: node.session.err_timeo.abort_timeout = 15
Nov 28 14:08:58 user nova-compute[75453]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 14:08:58 user nova-compute[75453]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 14:08:58 user nova-compute[75453]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.FastAbort = Yes
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.InitialR2T = No
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.ImmediateData = Yes
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.MaxConnections = 1
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 14:08:58 user nova-compute[75453]: node.session.iscsi.ERL = 0
Nov 28 14:08:58 user nova-compute[75453]: node.session.scan = manual
Nov 28 14:08:58 user nova-compute[75453]: node.session.reopen_max = 0
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].address = 172.16.0.220
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].port = 3260
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].startup = manual
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].tcp.window_size = 524288
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].tcp.type_of_service = 0
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].timeo.logout_timeout = 15
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].timeo.login_timeout = 15
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].timeo.auth_timeout = 45
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].iscsi.DataDigest = None
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].iscsi.IFMarker = No
Nov 28 14:08:58 user nova-compute[75453]: node.conn[0].iscsi.OFMarker = No
Nov 28 14:08:58 user nova-compute[75453]: # END RECORD
Nov 28 14:08:58 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:58 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c693d6cb-4571-497c-bdac-cbff6c4d8453]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.081s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[192c0ce9-09a6-4221-a605-af4860d7e3b4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMaiwmKb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMaiwmKb" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d6da37-3eea-4230-b47f-89b92d31cb79]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nMaiwmKb'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[081536e9-5b57-4ba1-9bf8-9d200e5ac7bb]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6dafbf-71ca-4587-a7ce-a49e3b3eacfd]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:59 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:59 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:59 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:08:59 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:08:59 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:08:59 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:08:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] HCTL ('33', '0', '0', 0) found on session 31 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[769fe2f6-3f8e-47f6-9817-b63530bed998]: (4, ('0 0 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching for a device in session 31 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMaiwmKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.308s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] <== connect_volume: return (309ms) {'type': 'block', 'scsi_wwn': '26438613935383539', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438613935383539', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1272274120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1272274120',id=32,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-qjub5cqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:07:23Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=db5b1a94-7308-4e99-bc57-025611be1f23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "vif_mac": "fa:16:3e:f5:2b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "vif_mac": "fa:16:3e:f5:2b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=f6df96a1-9fa2-447c-b0f6-9f53f1521839,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6df96a1-9f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'pci_devices' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.objects.instance [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'flavor' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.objects.base [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<db5b1a94-7308-4e99-bc57-025611be1f23> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:08:59 user nova-compute[75453]:   <uuid>db5b1a94-7308-4e99-bc57-025611be1f23</uuid>
Nov 28 14:08:59 user nova-compute[75453]:   <name>instance-00000020</name>
Nov 28 14:08:59 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:08:59 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:08:59 user nova-compute[75453]:   <metadata>
Nov 28 14:08:59 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:08:59 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:08:59 user nova-compute[75453]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1272274120</nova:name>
Nov 28 14:08:59 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:08:58</nova:creationTime>
Nov 28 14:08:59 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:08:59 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:08:59 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:08:59 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:08:59 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:08:59 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:08:59 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:08:59 user nova-compute[75453]:       <nova:owner>
Nov 28 14:08:59 user nova-compute[75453]:         <nova:user uuid="f88c92554f0f44b0be661aa40aec8670">tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member</nova:user>
Nov 28 14:08:59 user nova-compute[75453]:         <nova:project uuid="3de3b398da714d8cb92fad7f64d5c64e">tempest-ServerBootFromVolumeStableRescueTest-682344680</nova:project>
Nov 28 14:08:59 user nova-compute[75453]:       </nova:owner>
Nov 28 14:08:59 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:08:59 user nova-compute[75453]:       <nova:ports>
Nov 28 14:08:59 user nova-compute[75453]:         <nova:port uuid="f6df96a1-9fa2-447c-b0f6-9f53f1521839">
Nov 28 14:08:59 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 14:08:59 user nova-compute[75453]:         </nova:port>
Nov 28 14:08:59 user nova-compute[75453]:       </nova:ports>
Nov 28 14:08:59 user nova-compute[75453]:     </nova:instance>
Nov 28 14:08:59 user nova-compute[75453]:   </metadata>
Nov 28 14:08:59 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:08:59 user nova-compute[75453]:     <system>
Nov 28 14:08:59 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:08:59 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:08:59 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:08:59 user nova-compute[75453]:       <entry name="serial">db5b1a94-7308-4e99-bc57-025611be1f23</entry>
Nov 28 14:08:59 user nova-compute[75453]:       <entry name="uuid">db5b1a94-7308-4e99-bc57-025611be1f23</entry>
Nov 28 14:08:59 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:08:59 user nova-compute[75453]:     </system>
Nov 28 14:08:59 user nova-compute[75453]:   </sysinfo>
Nov 28 14:08:59 user nova-compute[75453]:   <os>
Nov 28 14:08:59 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:08:59 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:08:59 user nova-compute[75453]:   </os>
Nov 28 14:08:59 user nova-compute[75453]:   <features>
Nov 28 14:08:59 user nova-compute[75453]:     <acpi/>
Nov 28 14:08:59 user nova-compute[75453]:     <apic/>
Nov 28 14:08:59 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:08:59 user nova-compute[75453]:   </features>
Nov 28 14:08:59 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:08:59 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:08:59 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:08:59 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:08:59 user nova-compute[75453]:   </clock>
Nov 28 14:08:59 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:08:59 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:08:59 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:08:59 user nova-compute[75453]:   </cpu>
Nov 28 14:08:59 user nova-compute[75453]:   <devices>
Nov 28 14:08:59 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:08:59 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:08:59 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:08:59 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:08:59 user nova-compute[75453]:       <serial>ec03014f-39a5-4b50-b96b-76fabf658cb0</serial>
Nov 28 14:08:59 user nova-compute[75453]:     </disk>
Nov 28 14:08:59 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:08:59 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:08:59 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue"/>
Nov 28 14:08:59 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 14:08:59 user nova-compute[75453]:       <boot order="1"/>
Nov 28 14:08:59 user nova-compute[75453]:     </disk>
Nov 28 14:08:59 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:08:59 user nova-compute[75453]:       <mac address="fa:16:3e:f5:2b:72"/>
Nov 28 14:08:59 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:08:59 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:08:59 user nova-compute[75453]:       <target dev="tapf6df96a1-9f"/>
Nov 28 14:08:59 user nova-compute[75453]:     </interface>
Nov 28 14:08:59 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:08:59 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/console.log" append="off"/>
Nov 28 14:08:59 user nova-compute[75453]:     </serial>
Nov 28 14:08:59 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:08:59 user nova-compute[75453]:     <video>
Nov 28 14:08:59 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:08:59 user nova-compute[75453]:     </video>
Nov 28 14:08:59 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:08:59 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:08:59 user nova-compute[75453]:     </rng>
Nov 28 14:08:59 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:08:59 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:08:59 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:08:59 user nova-compute[75453]:     </memballoon>
Nov 28 14:08:59 user nova-compute[75453]:   </devices>
Nov 28 14:08:59 user nova-compute[75453]: </domain>
Nov 28 14:08:59 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:08:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Instance destroyed successfully.
Nov 28 14:08:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-79bace3a-bc93-44b4-b267-2c75c4b6ea41 tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.008s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No VIF found with MAC fa:16:3e:f5:2b:72, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:08:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:08:59 user nova-compute[75453]: WARNING nova.compute.manager [req-281646b5-0c48-41d6-ae33-8f016ae11a72 req-2cd8de1a-4fdc-449d-ac46-1af5f22400aa service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 14:09:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquired lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG nova.network.neutron [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG nova.network.neutron [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating instance_info_cache with network_info: [{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Releasing lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:09:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Creating image(s)
Nov 28 14:09:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG nova.objects.instance [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'trusted_certs' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG nova.objects.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<140e1e3c-a452-44b9-86d3-0e6232512665> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "529403a894f0a32ed9ee6c972cf38f6869b90ec7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "529403a894f0a32ed9ee6c972cf38f6869b90ec7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:09:01 user nova-compute[75453]: WARNING nova.compute.manager [req-0143162d-ab39-40d4-b73a-ffb818cb7717 req-d9a2e306-d134-4586-b76c-1650aa93a688 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state active and task_state rescuing.
Nov 28 14:09:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG nova.virt.images [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 86f857ee-58c7-403f-bab4-ef42dbf72c2a was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:09:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7.part /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-changed-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Refreshing instance network info cache due to event network-changed-d02ad480-f01f-442a-a00e-7dca16a27d3d. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Acquiring lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Acquired lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Refreshing network info cache for port d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7.part /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7.converted" returned: 0 in 0.411s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "529403a894f0a32ed9ee6c972cf38f6869b90ec7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.759s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updated VIF entry in instance network info cache for port d02ad480-f01f-442a-a00e-7dca16a27d3d. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating instance_info_cache with network_info: [{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Releasing lock "refresh_cache-140e1e3c-a452-44b9-86d3-0e6232512665" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:09:02 user nova-compute[75453]: WARNING nova.compute.manager [req-d878842c-a07b-4bac-b520-24e8560ff05a req-e4b4704a-1034-464a-b177-53013459299a service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7 --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "529403a894f0a32ed9ee6c972cf38f6869b90ec7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "529403a894f0a32ed9ee6c972cf38f6869b90ec7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7 --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7,backing_fmt=raw /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7,backing_fmt=raw /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk 1073741824" returned: 0 in 0.047s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "529403a894f0a32ed9ee6c972cf38f6869b90ec7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:02 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7 --force-share --output=json" returned: 0 in 0.214s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.objects.instance [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'migration_context' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:09:03 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Instance spawned successfully.
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.objects.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<140e1e3c-a452-44b9-86d3-0e6232512665> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:09:03 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Rebasing disk image.
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d -F raw /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.objects.instance [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75453) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:09:03 user nova-compute[75453]: WARNING nova.compute.manager [req-d1835bb7-2632-4b1e-937a-27081ed91a5a req-0a857b6c-9504-4229-bfe0-4f25b9255320 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state active and task_state rescuing.
Nov 28 14:09:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7b093175-40b3-4c21-99fa-0a96609626e6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.082s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f828ec98-96c9-4107-a874-f4864fb73c5d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:09:05 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:05 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c is timed out.
Nov 28 14:09:05 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully detached device vdc from instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c from the live domain config.
Nov 28 14:09:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:09:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKpCZayg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:09:05 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:09:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:09:05 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:09:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.084s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257dd82-8130-40b2-beb6-e14c14696b2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:09:06 user nova-compute[75453]: No targets found.
Nov 28 14:09:06 user nova-compute[75453]: iSNS:
Nov 28 14:09:06 user nova-compute[75453]: No targets found.
Nov 28 14:09:06 user nova-compute[75453]: STATIC:
Nov 28 14:09:06 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47
Nov 28 14:09:06 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:09:06 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:09:06 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102
Nov 28 14:09:06 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:09:06 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:09:06 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:09:06 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:09:06 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:09:06 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9
Nov 28 14:09:06 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:09:06 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:09:06 user nova-compute[75453]: FIRMWARE:
Nov 28 14:09:06 user nova-compute[75453]: No targets found.
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:09:06 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:09:06 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.048s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7645f3cd-c326-4213-b33b-3428988578dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[66208fc3-256c-428b-a7b2-c9a1104679d4]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c5a1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9'): ({'sde'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Removing single pathed devices sde {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d -F raw /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk" returned: 0 in 2.800s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Ensure instance console log exists: /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Start _get_guest_xml network_info=[{"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b71a9de6fbda4d0f744136de93142771',container_format='bare',created_at=2023-11-28T14:06:56Z,direct_url=<?>,disk_format='qcow2',id=86f857ee-58c7-403f-bab4-ef42dbf72c2a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-822996976-shelved',owner='bb60c747fc434b8a8bb9a0df65970d92',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T14:07:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5139ce68-966b-4758-a44e-decc8f65f876', 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfXbrYiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '140e1e3c-a452-44b9-86d3-0e6232512665', 'attached_at': '', 'detached_at': '', 'volume_id': '46ed5746-e152-40d9-b8c7-b33905d5b549', 'serial': '46ed5746-e152-40d9-b8c7-b33905d5b549'}, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:09:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:09:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b71a9de6fbda4d0f744136de93142771',container_format='bare',created_at=2023-11-28T14:06:56Z,direct_url=<?>,disk_format='qcow2',id=86f857ee-58c7-403f-bab4-ef42dbf72c2a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-822996976-shelved',owner='bb60c747fc434b8a8bb9a0df65970d92',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T14:07:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.objects.instance [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'vcpu_model' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.077s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[24021d7b-41fe-43ae-993c-74cf0aeea6b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.objects.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<140e1e3c-a452-44b9-86d3-0e6232512665> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfXbrYiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:09:06 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c120930-a46c-4e2e-9efa-df0fa34cfdee]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Flushing IO for device /dev/sde {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c2ef60-cbd2-4039-bbb6-d2573dc34744]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da5a387-bcd4-418a-9019-f746c830451f]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1ebac4-21ac-4dd3-b448-12753ad1a909]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca222577-0947-42d0-9018-45c798d7bbd5]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9, portal: 172.16.0.220,3260]
Nov 28 14:09:06 user nova-compute[75453]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9, portal: 172.16.0.220,3260] successful.
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4f3128e-03e1-4626-9cff-99ae0d0546d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a567f9d9-9c29-4905-a1c2-d72c86197d78]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.542s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] <== disconnect_volume: return (545ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.214s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:09:06 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:09:06 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03ffddf-b890-42f5-ac1b-f5f04e2a81eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:09:06 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4eec7f-3962-4ab3-ba97-7a511f500f6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549] added
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[db96dac7-ce63-4848-ad05-bc47b101e261]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef2adf2-f1a6-4697-9342-517a12c8af2b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfXbrYiQ {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfXbrYiQ" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[755dd10b-fd6f-4a63-a6b1-4c4d1340a5ef]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qfXbrYiQ'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b9f990-6133-4052-88c8-08ed50333c88]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c585e165-79dc-465b-9f1f-71dbd3df0dee]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e2a271-afe9-4b9e-8cb7-df34d39772f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549, portal: 172.16.0.220,3260]
Nov 28 14:09:06 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549, portal: 172.16.0.220,3260] successful.
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b46acb-12f2-4038-be68-4395cf8df84c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2b1671-32f9-4bd8-8b2f-00c6da25973a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 (non-flash)
Nov 28 14:09:06 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6d1807-47a8-49c0-a770-faef7988ccaf]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:09:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfXbrYiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.objects.instance [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'flavor' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-edd8177c-7cdc-412c-8a60-67a338828a73 tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.412s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] <== connect_volume: return (1625ms) {'type': 'block', 'scsi_wwn': '23763663062363462', 'path': '/dev/sde'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763663062363462', 'path': '/dev/sde'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-822996976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-822996976',id=24,image_ref='86f857ee-58c7-403f-bab4-ef42dbf72c2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1276374203',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-h8fb3xp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member',shelved_at='2023-11-28T14:07:01.154841',shelved_host='user',shelved_image_id='86f857ee-58c7-403f-bab4-ef42dbf72c2a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=140e1e3c-a452-44b9-86d3-0e6232512665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.objects.instance [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'pci_devices' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.objects.base [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<140e1e3c-a452-44b9-86d3-0e6232512665> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:09:07 user nova-compute[75453]:   <uuid>140e1e3c-a452-44b9-86d3-0e6232512665</uuid>
Nov 28 14:09:07 user nova-compute[75453]:   <name>instance-00000018</name>
Nov 28 14:09:07 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:09:07 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:09:07 user nova-compute[75453]:   <metadata>
Nov 28 14:09:07 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:09:07 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:09:07 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-822996976</nova:name>
Nov 28 14:09:07 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:09:06</nova:creationTime>
Nov 28 14:09:07 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:09:07 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:09:07 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:09:07 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:09:07 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:09:07 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:09:07 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:09:07 user nova-compute[75453]:       <nova:owner>
Nov 28 14:09:07 user nova-compute[75453]:         <nova:user uuid="e8074110936b461690a6518ddee180ac">tempest-AttachVolumeShelveTestJSON-1619345525-project-member</nova:user>
Nov 28 14:09:07 user nova-compute[75453]:         <nova:project uuid="bb60c747fc434b8a8bb9a0df65970d92">tempest-AttachVolumeShelveTestJSON-1619345525</nova:project>
Nov 28 14:09:07 user nova-compute[75453]:       </nova:owner>
Nov 28 14:09:07 user nova-compute[75453]:       <nova:root type="image" uuid="86f857ee-58c7-403f-bab4-ef42dbf72c2a"/>
Nov 28 14:09:07 user nova-compute[75453]:       <nova:ports>
Nov 28 14:09:07 user nova-compute[75453]:         <nova:port uuid="d02ad480-f01f-442a-a00e-7dca16a27d3d">
Nov 28 14:09:07 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 14:09:07 user nova-compute[75453]:         </nova:port>
Nov 28 14:09:07 user nova-compute[75453]:       </nova:ports>
Nov 28 14:09:07 user nova-compute[75453]:     </nova:instance>
Nov 28 14:09:07 user nova-compute[75453]:   </metadata>
Nov 28 14:09:07 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:09:07 user nova-compute[75453]:     <system>
Nov 28 14:09:07 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:09:07 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:09:07 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:09:07 user nova-compute[75453]:       <entry name="serial">140e1e3c-a452-44b9-86d3-0e6232512665</entry>
Nov 28 14:09:07 user nova-compute[75453]:       <entry name="uuid">140e1e3c-a452-44b9-86d3-0e6232512665</entry>
Nov 28 14:09:07 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:09:07 user nova-compute[75453]:     </system>
Nov 28 14:09:07 user nova-compute[75453]:   </sysinfo>
Nov 28 14:09:07 user nova-compute[75453]:   <os>
Nov 28 14:09:07 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:09:07 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:09:07 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:09:07 user nova-compute[75453]:   </os>
Nov 28 14:09:07 user nova-compute[75453]:   <features>
Nov 28 14:09:07 user nova-compute[75453]:     <acpi/>
Nov 28 14:09:07 user nova-compute[75453]:     <apic/>
Nov 28 14:09:07 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:09:07 user nova-compute[75453]:   </features>
Nov 28 14:09:07 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:09:07 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:09:07 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:09:07 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:09:07 user nova-compute[75453]:   </clock>
Nov 28 14:09:07 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:09:07 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:09:07 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:09:07 user nova-compute[75453]:   </cpu>
Nov 28 14:09:07 user nova-compute[75453]:   <devices>
Nov 28 14:09:07 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:09:07 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:09:07 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk"/>
Nov 28 14:09:07 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:09:07 user nova-compute[75453]:     </disk>
Nov 28 14:09:07 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:09:07 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:09:07 user nova-compute[75453]:       <source dev="/dev/sde"/>
Nov 28 14:09:07 user nova-compute[75453]:       <target dev="vdc" bus="virtio"/>
Nov 28 14:09:07 user nova-compute[75453]:       <serial>46ed5746-e152-40d9-b8c7-b33905d5b549</serial>
Nov 28 14:09:07 user nova-compute[75453]:     </disk>
Nov 28 14:09:07 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:09:07 user nova-compute[75453]:       <mac address="fa:16:3e:f4:21:2b"/>
Nov 28 14:09:07 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:09:07 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:09:07 user nova-compute[75453]:       <target dev="tapd02ad480-f0"/>
Nov 28 14:09:07 user nova-compute[75453]:     </interface>
Nov 28 14:09:07 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:09:07 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/console.log" append="off"/>
Nov 28 14:09:07 user nova-compute[75453]:     </serial>
Nov 28 14:09:07 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:09:07 user nova-compute[75453]:     <video>
Nov 28 14:09:07 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:09:07 user nova-compute[75453]:     </video>
Nov 28 14:09:07 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:09:07 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:09:07 user nova-compute[75453]:     </rng>
Nov 28 14:09:07 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:09:07 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:09:07 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:09:07 user nova-compute[75453]:     </memballoon>
Nov 28 14:09:07 user nova-compute[75453]:   </devices>
Nov 28 14:09:07 user nova-compute[75453]: </domain>
Nov 28 14:09:07 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-822996976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-822996976',id=24,image_ref='86f857ee-58c7-403f-bab4-ef42dbf72c2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1276374203',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-h8fb3xp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member',shelved_at='2023-11-28T14:07:01.154841',shelved_host='user',shelved_image_id='86f857ee-58c7-403f-bab4-ef42dbf72c2a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=140e1e3c-a452-44b9-86d3-0e6232512665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG os_vif [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87b24ac1-a83e-52a9-be89-0a0159657f0e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd02ad480-f0, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd02ad480-f0, col_values=(('qos', UUID('09584b93-29de-4094-b22d-86491b776b43')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd02ad480-f0, col_values=(('external_ids', {'iface-id': 'd02ad480-f01f-442a-a00e-7dca16a27d3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:21:2b', 'vm-uuid': '140e1e3c-a452-44b9-86d3-0e6232512665'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:07 user nova-compute[75453]: INFO os_vif [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0')
Nov 28 14:09:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] No VIF found with MAC fa:16:3e:f4:21:2b, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:08 user nova-compute[75453]: INFO nova.compute.manager [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Terminating instance
Nov 28 14:09:08 user nova-compute[75453]: DEBUG nova.compute.manager [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received event network-vif-unplugged-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] No waiting events found dispatching network-vif-unplugged-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ee7c44e-caaa-4cff-8177-a49b86119d3c req-e8221831-3239-4704-b4ab-0c8e7478b440 service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received event network-vif-unplugged-fe80bff8-4392-40bb-942f-b2095b29199c for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:09 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:09:09 user nova-compute[75453]: INFO nova.compute.claims [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Claim successful on node user
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:09:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Instance destroyed successfully.
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.objects.instance [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lazy-loading 'resources' on Instance uuid 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1436423002',display_name='tempest-AttachVolumeTestJSON-server-1436423002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1436423002',id=27,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFlWuxo8d8nXMdcMC+s1idcRUDtykbajPlJfdAc1yg+5uv17LczFuATBa/Zata1knPZjntuig8DVjH54qv+G83AvNVS75hcVNIAFU8NzNT2nYswUpaffMO1Rffqfi5Fxw==',key_name='tempest-keypair-391843838',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56b5137584864cf094d60d14e6f0ab0f',ramdisk_id='',reservation_id='r-e6w7inhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-15045878',owner_user_name='tempest-AttachVolumeTestJSON-15045878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c38a4b08cd204e2a9b313a7740df3f3e',uuid=527ef61d-2bf4-4e4d-8f21-ce54a9fe876c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converting VIF {"id": "fe80bff8-4392-40bb-942f-b2095b29199c", "address": "fa:16:3e:c1:6d:fe", "network": {"id": "44d4bd64-355a-4f2d-a009-466966959f54", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-920120202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b5137584864cf094d60d14e6f0ab0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe80bff8-43", "ovs_interfaceid": "fe80bff8-4392-40bb-942f-b2095b29199c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:6d:fe,bridge_name='br-int',has_traffic_filtering=True,id=fe80bff8-4392-40bb-942f-b2095b29199c,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80bff8-43') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG os_vif [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:6d:fe,bridge_name='br-int',has_traffic_filtering=True,id=fe80bff8-4392-40bb-942f-b2095b29199c,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80bff8-43') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe80bff8-43, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0783e1f-d411-4a80-b924-48a84d54922d) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:10 user nova-compute[75453]: INFO os_vif [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:6d:fe,bridge_name='br-int',has_traffic_filtering=True,id=fe80bff8-4392-40bb-942f-b2095b29199c,network=Network(44d4bd64-355a-4f2d-a009-466966959f54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe80bff8-43')
Nov 28 14:09:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Deleting instance files /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c_del
Nov 28 14:09:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Deletion of /opt/stack/data/nova/instances/527ef61d-2bf4-4e4d-8f21-ce54a9fe876c_del complete
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:09:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:09:10 user nova-compute[75453]: INFO nova.compute.manager [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Took 1.75 seconds to destroy the instance on the hypervisor.
Nov 28 14:09:10 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] No waiting events found dispatching network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:09:10 user nova-compute[75453]: WARNING nova.compute.manager [req-6ceb1827-2e1e-4286-b5bc-02353c5d83f1 req-91c0e78e-6d82-4168-a298-ecd164c86e8b service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received unexpected event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.policy [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4918246c1354b6a923ed07fd6136069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70602cf7cc04aed9d9f010e82cd37b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:09:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Creating image(s)
Nov 28 14:09:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "/opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "/opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.038s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.232s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.013s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.285s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received event network-vif-plugged-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] Acquiring lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] No waiting events found dispatching network-vif-plugged-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:09:11 user nova-compute[75453]: WARNING nova.compute.manager [req-0618b3d3-90d6-4c03-b9e7-6bb538f4bf2e req-3a69c23d-e2d9-4ad2-bea4-ecdbd12ddfcd service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received unexpected event network-vif-plugged-fe80bff8-4392-40bb-942f-b2095b29199c for instance with vm_state active and task_state deleting.
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk 1073741824" returned: 0 in 0.091s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Successfully created port: 8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:09:11 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Took 1.14 seconds to deallocate network for instance.
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.261s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-8b1f4b85-6739-4dc7-8d0f-7036c5cd33ef req-4bdf5161-b739-4438-b03c-549c20faf51d service nova] [instance: 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c] Received event network-vif-deleted-fe80bff8-4392-40bb-942f-b2095b29199c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Cannot resize image /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Ensure instance console log exists: /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:12 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Deleted allocations for instance 527ef61d-2bf4-4e4d-8f21-ce54a9fe876c
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Successfully updated port: 8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "refresh_cache-9ee48951-d5c7-4d89-ab05-766bbaf2edc3" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquired lock "refresh_cache-9ee48951-d5c7-4d89-ab05-766bbaf2edc3" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-44f5488c-c952-4c8c-a734-7091a063779a tempest-AttachVolumeTestJSON-15045878 tempest-AttachVolumeTestJSON-15045878-project-member] Lock "527ef61d-2bf4-4e4d-8f21-ce54a9fe876c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.573s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Updating instance_info_cache with network_info: [{"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Releasing lock "refresh_cache-9ee48951-d5c7-4d89-ab05-766bbaf2edc3" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Instance network_info: |[{"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Start _get_guest_xml network_info=[{"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:09:12 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:09:12 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-465880070',display_name='tempest-VolumesActionsTest-instance-465880070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-465880070',id=33,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d70602cf7cc04aed9d9f010e82cd37b3',ramdisk_id='',reservation_id='r-cg4wi19z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1229850681',owner_user_name='tempest-VolumesActionsTest-1229850681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:09:11Z,user_data=None,user_id='e4918246c1354b6a923ed07fd6136069',uuid=9ee48951-d5c7-4d89-ab05-766bbaf2edc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converting VIF {"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:ae,bridge_name='br-int',has_traffic_filtering=True,id=8df9d722-c1e7-4a3f-9631-ebf0acff9425,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df9d722-c1') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.objects.instance [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] No waiting events found dispatching network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:09:12 user nova-compute[75453]: WARNING nova.compute.manager [req-85ba781c-cb6c-4d89-af5b-49fd083bf959 req-16fb4e09-0844-469d-9b42-5f0d93d3b4a0 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received unexpected event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:09:12 user nova-compute[75453]:   <uuid>9ee48951-d5c7-4d89-ab05-766bbaf2edc3</uuid>
Nov 28 14:09:12 user nova-compute[75453]:   <name>instance-00000021</name>
Nov 28 14:09:12 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:09:12 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:09:12 user nova-compute[75453]:   <metadata>
Nov 28 14:09:12 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:09:12 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:09:12 user nova-compute[75453]:       <nova:name>tempest-VolumesActionsTest-instance-465880070</nova:name>
Nov 28 14:09:12 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:09:12</nova:creationTime>
Nov 28 14:09:12 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:09:12 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:09:12 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:09:12 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:09:12 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:09:12 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:09:12 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:09:12 user nova-compute[75453]:       <nova:owner>
Nov 28 14:09:12 user nova-compute[75453]:         <nova:user uuid="e4918246c1354b6a923ed07fd6136069">tempest-VolumesActionsTest-1229850681-project-member</nova:user>
Nov 28 14:09:12 user nova-compute[75453]:         <nova:project uuid="d70602cf7cc04aed9d9f010e82cd37b3">tempest-VolumesActionsTest-1229850681</nova:project>
Nov 28 14:09:12 user nova-compute[75453]:       </nova:owner>
Nov 28 14:09:12 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:09:12 user nova-compute[75453]:       <nova:ports>
Nov 28 14:09:12 user nova-compute[75453]:         <nova:port uuid="8df9d722-c1e7-4a3f-9631-ebf0acff9425">
Nov 28 14:09:12 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:09:12 user nova-compute[75453]:         </nova:port>
Nov 28 14:09:12 user nova-compute[75453]:       </nova:ports>
Nov 28 14:09:12 user nova-compute[75453]:     </nova:instance>
Nov 28 14:09:12 user nova-compute[75453]:   </metadata>
Nov 28 14:09:12 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:09:12 user nova-compute[75453]:     <system>
Nov 28 14:09:12 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:09:12 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:09:12 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:09:12 user nova-compute[75453]:       <entry name="serial">9ee48951-d5c7-4d89-ab05-766bbaf2edc3</entry>
Nov 28 14:09:12 user nova-compute[75453]:       <entry name="uuid">9ee48951-d5c7-4d89-ab05-766bbaf2edc3</entry>
Nov 28 14:09:12 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:09:12 user nova-compute[75453]:     </system>
Nov 28 14:09:12 user nova-compute[75453]:   </sysinfo>
Nov 28 14:09:12 user nova-compute[75453]:   <os>
Nov 28 14:09:12 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:09:12 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:09:12 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:09:12 user nova-compute[75453]:   </os>
Nov 28 14:09:12 user nova-compute[75453]:   <features>
Nov 28 14:09:12 user nova-compute[75453]:     <acpi/>
Nov 28 14:09:12 user nova-compute[75453]:     <apic/>
Nov 28 14:09:12 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:09:12 user nova-compute[75453]:   </features>
Nov 28 14:09:12 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:09:12 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:09:12 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:09:12 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:09:12 user nova-compute[75453]:   </clock>
Nov 28 14:09:12 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:09:12 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:09:12 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:09:12 user nova-compute[75453]:   </cpu>
Nov 28 14:09:12 user nova-compute[75453]:   <devices>
Nov 28 14:09:12 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:09:12 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:09:12 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk"/>
Nov 28 14:09:12 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:09:12 user nova-compute[75453]:     </disk>
Nov 28 14:09:12 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:09:12 user nova-compute[75453]:       <mac address="fa:16:3e:79:04:ae"/>
Nov 28 14:09:12 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:09:12 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:09:12 user nova-compute[75453]:       <target dev="tap8df9d722-c1"/>
Nov 28 14:09:12 user nova-compute[75453]:     </interface>
Nov 28 14:09:12 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:09:12 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/console.log" append="off"/>
Nov 28 14:09:12 user nova-compute[75453]:     </serial>
Nov 28 14:09:12 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:09:12 user nova-compute[75453]:     <video>
Nov 28 14:09:12 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:09:12 user nova-compute[75453]:     </video>
Nov 28 14:09:12 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:09:12 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:09:12 user nova-compute[75453]:     </rng>
Nov 28 14:09:12 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:09:12 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:09:12 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:09:12 user nova-compute[75453]:     </memballoon>
Nov 28 14:09:12 user nova-compute[75453]:   </devices>
Nov 28 14:09:12 user nova-compute[75453]: </domain>
Nov 28 14:09:12 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-465880070',display_name='tempest-VolumesActionsTest-instance-465880070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-465880070',id=33,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d70602cf7cc04aed9d9f010e82cd37b3',ramdisk_id='',reservation_id='r-cg4wi19z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1229850681',owner_user_name='tempest-VolumesActionsTest-1229850681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:09:11Z,user_data=None,user_id='e4918246c1354b6a923ed07fd6136069',uuid=9ee48951-d5c7-4d89-ab05-766bbaf2edc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converting VIF {"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:ae,bridge_name='br-int',has_traffic_filtering=True,id=8df9d722-c1e7-4a3f-9631-ebf0acff9425,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df9d722-c1') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG os_vif [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:ae,bridge_name='br-int',has_traffic_filtering=True,id=8df9d722-c1e7-4a3f-9631-ebf0acff9425,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df9d722-c1') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f75cc911-c8c5-5658-859e-59ad3fbcc316', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8df9d722-c1, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8df9d722-c1, col_values=(('qos', UUID('b62aab40-fa03-4b24-b353-600827bd05c4')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8df9d722-c1, col_values=(('external_ids', {'iface-id': '8df9d722-c1e7-4a3f-9631-ebf0acff9425', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:04:ae', 'vm-uuid': '9ee48951-d5c7-4d89-ab05-766bbaf2edc3'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:12 user nova-compute[75453]: INFO os_vif [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:ae,bridge_name='br-int',has_traffic_filtering=True,id=8df9d722-c1e7-4a3f-9631-ebf0acff9425,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df9d722-c1')
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:09:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] No VIF found with MAC fa:16:3e:79:04:ae, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:09:13 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance spawned successfully.
Nov 28 14:09:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG nova.compute.manager [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received event network-changed-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG nova.compute.manager [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Refreshing instance network info cache due to event network-changed-8df9d722-c1e7-4a3f-9631-ebf0acff9425. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] Acquiring lock "refresh_cache-9ee48951-d5c7-4d89-ab05-766bbaf2edc3" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] Acquired lock "refresh_cache-9ee48951-d5c7-4d89-ab05-766bbaf2edc3" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG nova.network.neutron [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Refreshing network info cache for port 8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70294142-cec3-4d8b-9eff-e107211ce3a1 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.754s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG nova.network.neutron [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Updated VIF entry in instance network info cache for port 8df9d722-c1e7-4a3f-9631-ebf0acff9425. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG nova.network.neutron [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Updating instance_info_cache with network_info: [{"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:09:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7b1c5869-b465-4339-a7d7-335770b048f5 req-94d943df-6fb4-4240-8fcf-32ca2394e990 service nova] Releasing lock "refresh_cache-9ee48951-d5c7-4d89-ab05-766bbaf2edc3" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Skipping network cache update for instance because it is Building. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid b531830d-1e76-4b07-bed1-2b009e235382 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG nova.compute.manager [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received event network-vif-plugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] Acquiring lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:14 user nova-compute[75453]: DEBUG nova.compute.manager [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] No waiting events found dispatching network-vif-plugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:09:14 user nova-compute[75453]: WARNING nova.compute.manager [req-435243dc-a880-4ae8-985a-27a2a3f56896 req-301a9616-e313-4922-85eb-9921d738cef3 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received unexpected event network-vif-plugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance with vm_state building and task_state spawning.
Nov 28 14:09:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updating instance_info_cache with network_info: [{"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:09:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:16 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.compute.manager [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received event network-vif-plugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] Acquiring lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.compute.manager [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] No waiting events found dispatching network-vif-plugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:09:17 user nova-compute[75453]: WARNING nova.compute.manager [req-0467e303-a9b4-4903-a90c-e342fb969397 req-6a37185c-71e8-4b5b-84b4-9b7e596f3792 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received unexpected event network-vif-plugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance with vm_state building and task_state spawning.
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:09:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Instance spawned successfully.
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:09:17 user nova-compute[75453]: INFO nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:17 user nova-compute[75453]: INFO nova.compute.manager [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Took 7.97 seconds to build instance.
Nov 28 14:09:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-eea544a4-5f0a-4b9d-8864-79048fa1ce29 tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.109s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue --force-share --output=json" returned: 0 in 0.295s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:09:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7968MB free_disk=25.12929916381836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 62c8d241-26ff-431e-98de-56c2941cf895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 8ea60b55-d974-4262-9413-37459394f8a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 140e1e3c-a452-44b9-86d3-0e6232512665 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:09:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:09:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:09:25 user nova-compute[75453]: INFO nova.compute.manager [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Detaching volume d06aa0b6-3395-4fb7-ad77-b637fad36102
Nov 28 14:09:25 user nova-compute[75453]: INFO nova.virt.block_device [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Attempting to driver detach volume d06aa0b6-3395-4fb7-ad77-b637fad36102 from mountpoint /dev/vdb
Nov 28 14:09:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Attempting to detach device vdb from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:09:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:09:26 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:09:26 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:09:26 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:09:26 user nova-compute[75453]:   <serial>d06aa0b6-3395-4fb7-ad77-b637fad36102</serial>
Nov 28 14:09:26 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:09:26 user nova-compute[75453]: </disk>
Nov 28 14:09:26 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:09:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Successfully detached device vdb from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 from the persistent domain config.
Nov 28 14:09:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:09:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:09:26 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:09:26 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:09:26 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:09:26 user nova-compute[75453]:   <serial>d06aa0b6-3395-4fb7-ad77-b637fad36102</serial>
Nov 28 14:09:26 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:09:26 user nova-compute[75453]: </disk>
Nov 28 14:09:26 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:09:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:09:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:09:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:46 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 is timed out.
Nov 28 14:09:46 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Successfully detached device vdb from instance bed61555-342d-46bc-95c6-4f94b8c5bbe5 from the live domain config.
Nov 28 14:09:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VHCTWyKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:09:46 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[af66fc27-879f-46db-b896-38a1679a5c4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:09:46 user nova-compute[75453]: No targets found.
Nov 28 14:09:46 user nova-compute[75453]: iSNS:
Nov 28 14:09:46 user nova-compute[75453]: No targets found.
Nov 28 14:09:46 user nova-compute[75453]: STATIC:
Nov 28 14:09:46 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47
Nov 28 14:09:46 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:09:46 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:09:46 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549
Nov 28 14:09:46 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:09:46 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:09:46 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102
Nov 28 14:09:46 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:09:46 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:09:46 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:09:46 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:09:46 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:09:46 user nova-compute[75453]: FIRMWARE:
Nov 28 14:09:46 user nova-compute[75453]: No targets found.
Nov 28 14:09:46 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:09:46 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:09:46 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[645fb566-5ded-4824-8c96-e401b92a24c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1866359-5575-4f71-a215-6cce056a28b2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:09:46 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:09:46 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:09:46 user nova-compute[75453]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 (non-flash)
Nov 28 14:09:46 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:09:46 user nova-compute[75453]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 (non-flash)
Nov 28 14:09:46 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:09:46 user nova-compute[75453]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 (non-flash)
Nov 28 14:09:46 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02186e9a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c868628e-f610-4b8c-a666-58ab45911232]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[267017a7-4d05-4abd-9688-e0ae94eaccf0]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f475a1-f35c-4a49-b47c-8102ac813500]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b8935-73ce-4f53-94c5-0efabc0f6c15]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[31086d0f-3be0-48b3-a7aa-27eb9b1ab858]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f71bb02-ab97-405b-8495-865de5bdcb54]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102, portal: 172.16.0.220,3260]
Nov 28 14:09:46 user nova-compute[75453]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102, portal: 172.16.0.220,3260] successful.
Nov 28 14:09:46 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d06aa0b6-3395-4fb7-ad77-b637fad36102 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bb5177-eaea-4fe0-8a95-bf1c070f53f0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] <== disconnect_volume: return (338ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:09:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:09:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:47 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'flavor' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:09:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f004f7e9-cf92-4c10-b1ef-659d0c84e06e tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.011s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:09:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:09:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:10:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:10:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:10:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:10:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:10:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:10:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:10:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:10:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:14 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:10:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:10:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:10:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:10:14 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:10:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updating instance_info_cache with network_info: [{"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:10:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:10:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:10:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:10:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:10:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:16 user nova-compute[75453]: INFO nova.compute.manager [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Terminating instance
Nov 28 14:10:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received event network-vif-unplugged-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] No waiting events found dispatching network-vif-unplugged-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:10:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-d1ba4b97-5a16-4d3d-9d4d-3e8a52c0438b req-c309b0d6-38a3-433f-a4dd-5d1e4a00260a service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received event network-vif-unplugged-0ba0a0df-c224-46cd-b429-d360d113d576 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Instance destroyed successfully.
Nov 28 14:10:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lazy-loading 'resources' on Instance uuid bed61555-342d-46bc-95c6-4f94b8c5bbe5 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2012684965',display_name='tempest-TestServerVolumeAttachmentScenario-server-2012684965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2012684965',id=28,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlM2hXaV3Pzjaj6/HdedyPOs6vnZt3xznkE5NqteNJ5ty/uea2Qpug6fvXqeAxpNO+mcSDzqo4TKu7ZmhNltk+7KVpKJxd2Pa3kqXStGtiqGOQWQzNfe4hrBobKEC8l4A==',key_name='tempest-keypair-1951635767',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c0c4bb4dbc142aeaa4974495fd6f9a5',ramdisk_id='',reservation_id='r-n4hgzv8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1145915269',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1145915269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9d2a50791634583ace0b93cb1459256',uuid=bed61555-342d-46bc-95c6-4f94b8c5bbe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Converting VIF {"id": "0ba0a0df-c224-46cd-b429-d360d113d576", "address": "fa:16:3e:a5:78:ca", "network": {"id": "1cdb9e59-4649-491d-b333-8a4aa7e9b358", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-963037200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0c4bb4dbc142aeaa4974495fd6f9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba0a0df-c2", "ovs_interfaceid": "0ba0a0df-c224-46cd-b429-d360d113d576", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=0ba0a0df-c224-46cd-b429-d360d113d576,network=Network(1cdb9e59-4649-491d-b333-8a4aa7e9b358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba0a0df-c2') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG os_vif [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=0ba0a0df-c224-46cd-b429-d360d113d576,network=Network(1cdb9e59-4649-491d-b333-8a4aa7e9b358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba0a0df-c2') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ba0a0df-c2, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb0d44ad-a6ec-43b2-93bc-08b19c1d940f) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:10:17 user nova-compute[75453]: INFO os_vif [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=0ba0a0df-c224-46cd-b429-d360d113d576,network=Network(1cdb9e59-4649-491d-b333-8a4aa7e9b358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba0a0df-c2')
Nov 28 14:10:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Deleting instance files /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5_del
Nov 28 14:10:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Deletion of /opt/stack/data/nova/instances/bed61555-342d-46bc-95c6-4f94b8c5bbe5_del complete
Nov 28 14:10:17 user nova-compute[75453]: INFO nova.compute.manager [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 14:10:17 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:10:18 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Took 0.80 seconds to deallocate network for instance.
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:10:18 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid 'bed61555-342d-46bc-95c6-4f94b8c5bbe5' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'bed61555-342d-46bc-95c6-4f94b8c5bbe5' (instance-0000001c)
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:18 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Deleted allocations for instance bed61555-342d-46bc-95c6-4f94b8c5bbe5
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received event network-vif-plugged-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] Acquiring lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] No waiting events found dispatching network-vif-plugged-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:10:18 user nova-compute[75453]: WARNING nova.compute.manager [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received unexpected event network-vif-plugged-0ba0a0df-c224-46cd-b429-d360d113d576 for instance with vm_state deleted and task_state None.
Nov 28 14:10:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-83aa8734-5ce0-4f8c-af71-abb30846734a req-4de391c1-2704-4981-af8b-fd6219316d8c service nova] [instance: bed61555-342d-46bc-95c6-4f94b8c5bbe5] Received event network-vif-deleted-0ba0a0df-c224-46cd-b429-d360d113d576 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-146b000f-f7c6-4a5f-b96e-cb0929efa7ff tempest-TestServerVolumeAttachmentScenario-1145915269 tempest-TestServerVolumeAttachmentScenario-1145915269-project-member] Lock "bed61555-342d-46bc-95c6-4f94b8c5bbe5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:10:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=7890MB free_disk=25.05957794189453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 62c8d241-26ff-431e-98de-56c2941cf895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 8ea60b55-d974-4262-9413-37459394f8a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 140e1e3c-a452-44b9-86d3-0e6232512665 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:10:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:10:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:10:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:10:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:10:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:10:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:10:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:10:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:38 user nova-compute[75453]: INFO nova.compute.manager [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Detaching volume 46ed5746-e152-40d9-b8c7-b33905d5b549
Nov 28 14:10:39 user nova-compute[75453]: INFO nova.virt.block_device [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Attempting to driver detach volume 46ed5746-e152-40d9-b8c7-b33905d5b549 from mountpoint /dev/vdc
Nov 28 14:10:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Attempting to detach device vdc from instance 140e1e3c-a452-44b9-86d3-0e6232512665 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:10:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:10:39 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:10:39 user nova-compute[75453]:   <source dev="/dev/sde"/>
Nov 28 14:10:39 user nova-compute[75453]:   <target dev="vdc" bus="virtio"/>
Nov 28 14:10:39 user nova-compute[75453]:   <serial>46ed5746-e152-40d9-b8c7-b33905d5b549</serial>
Nov 28 14:10:39 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 14:10:39 user nova-compute[75453]: </disk>
Nov 28 14:10:39 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:10:39 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully detached device vdc from instance 140e1e3c-a452-44b9-86d3-0e6232512665 from the persistent domain config.
Nov 28 14:10:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 140e1e3c-a452-44b9-86d3-0e6232512665 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:10:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:10:39 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:10:39 user nova-compute[75453]:   <source dev="/dev/sde"/>
Nov 28 14:10:39 user nova-compute[75453]:   <target dev="vdc" bus="virtio"/>
Nov 28 14:10:39 user nova-compute[75453]:   <serial>46ed5746-e152-40d9-b8c7-b33905d5b549</serial>
Nov 28 14:10:39 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 14:10:39 user nova-compute[75453]: </disk>
Nov 28 14:10:39 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:10:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:10:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:46 user nova-compute[75453]: INFO nova.compute.manager [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Unrescuing
Nov 28 14:10:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquired lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updating instance_info_cache with network_info: [{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Releasing lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG nova.objects.instance [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'flavor' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-unplugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-unplugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:10:46 user nova-compute[75453]: WARNING nova.compute.manager [req-00d141e3-6640-4572-be29-5d1be0109fdc req-77f98e5b-06d2-4ed6-ad5f-796070d787ae service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-unplugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:10:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Instance destroyed successfully.
Nov 28 14:10:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:10:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:10:49 user nova-compute[75453]: WARNING nova.compute.manager [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:10:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:10:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:10:49 user nova-compute[75453]: WARNING nova.compute.manager [req-131dc1f9-cf82-43c7-afc7-b4fc363e0c78 req-53182409-8c33-4e6b-ad1a-ccdc9ff46d12 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:10:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:10:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:10:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:10:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:10:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:10:51 user nova-compute[75453]: WARNING nova.compute.manager [req-d682141a-f8ee-41e9-9dcc-8d7288f3ade6 req-0e2ec7cc-d79a-4ce0-9d32-364d7c944787 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:10:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4b8b2b30-b1ff-47d9-8f90-48d2670a4efc tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:10:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:10:59 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 140e1e3c-a452-44b9-86d3-0e6232512665 is timed out.
Nov 28 14:10:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully detached device vdc from instance 140e1e3c-a452-44b9-86d3-0e6232512665 from the live domain config.
Nov 28 14:10:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfXbrYiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:10:59 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e61a07a-4862-4ede-8a8d-2e3d1d10b9fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:10:59 user nova-compute[75453]: No targets found.
Nov 28 14:10:59 user nova-compute[75453]: iSNS:
Nov 28 14:10:59 user nova-compute[75453]: No targets found.
Nov 28 14:10:59 user nova-compute[75453]: STATIC:
Nov 28 14:10:59 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47
Nov 28 14:10:59 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:10:59 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:10:59 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549
Nov 28 14:10:59 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:10:59 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:10:59 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:10:59 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:10:59 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:10:59 user nova-compute[75453]: FIRMWARE:
Nov 28 14:10:59 user nova-compute[75453]: No targets found.
Nov 28 14:10:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:10:59 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:10:59 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b470980-3464-409f-8f83-d24ca15a780c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0046cabf-bcb8-4ebb-a6c4-5942293c40ba]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:10:59 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:10:59 user nova-compute[75453]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 (non-flash)
Nov 28 14:10:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:10:59 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:10:59 user nova-compute[75453]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 (non-flash)
Nov 28 14:10:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02186fd360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549'): ({'sde'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Removing single pathed devices sde {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[873600fd-1b04-4ac1-93be-e4f1d15bc0ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce856c24-9592-4bdd-a5d3-e93583f3fa3d]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flushing IO for device /dev/sde {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:10:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55d172b-3cc0-4b9d-bdf0-d1b7249400e8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f45a2a-ada3-4a55-aeec-b236a014b2c2]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] SCSI volumes sde have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab9e400-afe8-4814-b81e-61008ae124fb]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[225c8c06-ed7b-400f-af11-ca184cdb87a9]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549, portal: 172.16.0.220,3260]
Nov 28 14:11:00 user nova-compute[75453]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549, portal: 172.16.0.220,3260] successful.
Nov 28 14:11:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46ed5746-e152-40d9-b8c7-b33905d5b549 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd684a-5ed2-4d2c-af9e-a750ab89a260]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] <== disconnect_volume: return (351ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:00 user nova-compute[75453]: INFO nova.compute.manager [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Terminating instance
Nov 28 14:11:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received event network-vif-unplugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] Acquiring lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] No waiting events found dispatching network-vif-unplugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:11:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-59580c76-f34d-4581-bb78-52a1dd3ce742 req-7080098f-98c0-4fd8-ba9b-5e7776ed0f8b service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received event network-vif-unplugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG nova.objects.instance [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'flavor' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a3cd44-c05a-4dcc-8b78-e866f551761a tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.419s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Instance destroyed successfully.
Nov 28 14:11:01 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lazy-loading 'resources' on Instance uuid 9ee48951-d5c7-4d89-ab05-766bbaf2edc3 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-465880070',display_name='tempest-VolumesActionsTest-instance-465880070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-465880070',id=33,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:09:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d70602cf7cc04aed9d9f010e82cd37b3',ramdisk_id='',reservation_id='r-cg4wi19z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1229850681',owner_user_name='tempest-VolumesActionsTest-1229850681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:09:18Z,user_data=None,user_id='e4918246c1354b6a923ed07fd6136069',uuid=9ee48951-d5c7-4d89-ab05-766bbaf2edc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converting VIF {"id": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "address": "fa:16:3e:79:04:ae", "network": {"id": "39e05b38-9721-451b-a6d4-fa95e025bcc2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1055910275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d70602cf7cc04aed9d9f010e82cd37b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df9d722-c1", "ovs_interfaceid": "8df9d722-c1e7-4a3f-9631-ebf0acff9425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:ae,bridge_name='br-int',has_traffic_filtering=True,id=8df9d722-c1e7-4a3f-9631-ebf0acff9425,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df9d722-c1') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG os_vif [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:ae,bridge_name='br-int',has_traffic_filtering=True,id=8df9d722-c1e7-4a3f-9631-ebf0acff9425,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df9d722-c1') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8df9d722-c1, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b62aab40-fa03-4b24-b353-600827bd05c4) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:01 user nova-compute[75453]: INFO os_vif [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:04:ae,bridge_name='br-int',has_traffic_filtering=True,id=8df9d722-c1e7-4a3f-9631-ebf0acff9425,network=Network(39e05b38-9721-451b-a6d4-fa95e025bcc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df9d722-c1')
Nov 28 14:11:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Deleting instance files /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3_del
Nov 28 14:11:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Deletion of /opt/stack/data/nova/instances/9ee48951-d5c7-4d89-ab05-766bbaf2edc3_del complete
Nov 28 14:11:01 user nova-compute[75453]: INFO nova.compute.manager [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 28 14:11:01 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:01 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:11:01 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Took 0.50 seconds to deallocate network for instance.
Nov 28 14:11:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-8cdba597-ea41-49bb-a4f6-90eff3e0dc62 req-6973245b-83ec-48e6-8342-c04f9e3ee061 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received event network-vif-deleted-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:02 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Deleted allocations for instance 9ee48951-d5c7-4d89-ab05-766bbaf2edc3
Nov 28 14:11:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bcea328-3d74-4058-bba4-d0b9a47d591e tempest-VolumesActionsTest-1229850681 tempest-VolumesActionsTest-1229850681-project-member] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received event network-vif-plugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] Acquiring lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] Lock "9ee48951-d5c7-4d89-ab05-766bbaf2edc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] No waiting events found dispatching network-vif-plugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:11:02 user nova-compute[75453]: WARNING nova.compute.manager [req-b4833dc4-83a8-42c8-8536-4cdfaccb0d97 req-0adab99b-8e26-4b02-a1f2-b7aea1be3dd3 service nova] [instance: 9ee48951-d5c7-4d89-ab05-766bbaf2edc3] Received unexpected event network-vif-plugged-8df9d722-c1e7-4a3f-9631-ebf0acff9425 for instance with vm_state deleted and task_state None.
Nov 28 14:11:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:11:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:11:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:11:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-8ea60b55-d974-4262-9413-37459394f8a6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:11:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-8ea60b55-d974-4262-9413-37459394f8a6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:11:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:11:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:11:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Updating instance_info_cache with network_info: [{"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:11:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-8ea60b55-d974-4262-9413-37459394f8a6" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:11:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:11:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:11:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:11:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:21 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:11:21 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8327MB free_disk=25.095844268798828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 62c8d241-26ff-431e-98de-56c2941cf895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 8ea60b55-d974-4262-9413-37459394f8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 140e1e3c-a452-44b9-86d3-0e6232512665 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:11:21 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:11:24 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:11:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:29 user nova-compute[75453]: INFO nova.compute.manager [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Terminating instance
Nov 28 14:11:29 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-unplugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] No waiting events found dispatching network-vif-unplugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-f5276a0c-32d6-4b1e-95a7-a870d1be3ed7 req-f5554979-a322-4d08-afe9-ba723d6ea6a8 service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-unplugged-d02ad480-f01f-442a-a00e-7dca16a27d3d for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:30 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Instance destroyed successfully.
Nov 28 14:11:30 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'resources' on Instance uuid 140e1e3c-a452-44b9-86d3-0e6232512665 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-822996976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-822996976',id=24,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRx1CaHhz7T4iWZHcZU/u7mxv1qFYSTYPVbEd+1AG15eK9htz2w/1zgpgePgXRBe/1I2oHV07JSN71mZsmDsoUxJkz8utVlRxN75p5/8zRBkg+ecBdhPIs3fNz9MW2gDA==',key_name='tempest-keypair-1276374203',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:09:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-h8fb3xp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=140e1e3c-a452-44b9-86d3-0e6232512665,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "address": "fa:16:3e:f4:21:2b", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd02ad480-f0", "ovs_interfaceid": "d02ad480-f01f-442a-a00e-7dca16a27d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG os_vif [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd02ad480-f0, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09584b93-29de-4094-b22d-86491b776b43) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:11:30 user nova-compute[75453]: INFO os_vif [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:21:2b,bridge_name='br-int',has_traffic_filtering=True,id=d02ad480-f01f-442a-a00e-7dca16a27d3d,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd02ad480-f0')
Nov 28 14:11:30 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Deleting instance files /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665_del
Nov 28 14:11:30 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Deletion of /opt/stack/data/nova/instances/140e1e3c-a452-44b9-86d3-0e6232512665_del complete
Nov 28 14:11:30 user nova-compute[75453]: INFO nova.compute.manager [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 14:11:30 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:11:30 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:11:31 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Took 1.11 seconds to deallocate network for instance.
Nov 28 14:11:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-deleted-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:11:31 user nova-compute[75453]: INFO nova.compute.manager [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Neutron deleted interface d02ad480-f01f-442a-a00e-7dca16a27d3d; detaching it from the instance and deleting it from the info cache
Nov 28 14:11:31 user nova-compute[75453]: DEBUG nova.network.neutron [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-5d9d76cc-d46b-463f-8d0a-060ce7f0e45d req-72b63fdb-a54f-483c-98d2-469a30d6068f service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Detach interface failed, port_id=d02ad480-f01f-442a-a00e-7dca16a27d3d, reason: Instance 140e1e3c-a452-44b9-86d3-0e6232512665 could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] Acquiring lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] Lock "140e1e3c-a452-44b9-86d3-0e6232512665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] No waiting events found dispatching network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:11:31 user nova-compute[75453]: WARNING nova.compute.manager [req-578a3c4c-ee27-4468-b672-c5d66ffc6484 req-7be1da1a-006c-4297-8d2f-c40caf96a9de service nova] [instance: 140e1e3c-a452-44b9-86d3-0e6232512665] Received unexpected event network-vif-plugged-d02ad480-f01f-442a-a00e-7dca16a27d3d for instance with vm_state deleted and task_state None.
Nov 28 14:11:31 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:11:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:31 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Deleted allocations for instance 140e1e3c-a452-44b9-86d3-0e6232512665
Nov 28 14:11:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1bc9f19f-3e07-4639-b6eb-71962fd7ce02 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "140e1e3c-a452-44b9-86d3-0e6232512665" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.689s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:35 user nova-compute[75453]: INFO nova.compute.manager [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Detaching volume 38b03b35-b011-46d4-ab6f-2bd994f14c47
Nov 28 14:11:35 user nova-compute[75453]: INFO nova.virt.block_device [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Attempting to driver detach volume 38b03b35-b011-46d4-ab6f-2bd994f14c47 from mountpoint /dev/vdb
Nov 28 14:11:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Attempting to detach device vdb from instance 62c8d241-26ff-431e-98de-56c2941cf895 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:11:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:11:35 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:11:35 user nova-compute[75453]:   <source dev="/dev/sdd"/>
Nov 28 14:11:35 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:11:35 user nova-compute[75453]:   <serial>38b03b35-b011-46d4-ab6f-2bd994f14c47</serial>
Nov 28 14:11:35 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 14:11:35 user nova-compute[75453]: </disk>
Nov 28 14:11:35 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:11:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully detached device vdb from instance 62c8d241-26ff-431e-98de-56c2941cf895 from the persistent domain config.
Nov 28 14:11:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62c8d241-26ff-431e-98de-56c2941cf895 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:11:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:11:35 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:11:35 user nova-compute[75453]:   <source dev="/dev/sdd"/>
Nov 28 14:11:35 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:11:35 user nova-compute[75453]:   <serial>38b03b35-b011-46d4-ab6f-2bd994f14c47</serial>
Nov 28 14:11:35 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 14:11:35 user nova-compute[75453]: </disk>
Nov 28 14:11:35 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:11:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62c8d241-26ff-431e-98de-56c2941cf895 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:11:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:11:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:11:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:11:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:11:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_power_states {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid b531830d-1e76-4b07-bed1-2b009e235382 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 839b0b0f-101d-46ca-97a8-ab404cc35ea9 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 8ea60b55-d974-4262-9413-37459394f8a6 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 62c8d241-26ff-431e-98de-56c2941cf895 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "b531830d-1e76-4b07-bed1-2b009e235382" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "b531830d-1e76-4b07-bed1-2b009e235382" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.004s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "8ea60b55-d974-4262-9413-37459394f8a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "db5b1a94-7308-4e99-bc57-025611be1f23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "b531830d-1e76-4b07-bed1-2b009e235382" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "8ea60b55-d974-4262-9413-37459394f8a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "db5b1a94-7308-4e99-bc57-025611be1f23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:56 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 62c8d241-26ff-431e-98de-56c2941cf895 is timed out.
Nov 28 14:11:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully detached device vdb from instance 62c8d241-26ff-431e-98de-56c2941cf895 from the live domain config.
Nov 28 14:11:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wCtsVrbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:11:56 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ac2785-fd2b-4ea5-a866-c0081b328587]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:11:56 user nova-compute[75453]: No targets found.
Nov 28 14:11:56 user nova-compute[75453]: iSNS:
Nov 28 14:11:56 user nova-compute[75453]: No targets found.
Nov 28 14:11:56 user nova-compute[75453]: STATIC:
Nov 28 14:11:56 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47
Nov 28 14:11:56 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:11:56 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:11:56 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:11:56 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:11:56 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:11:56 user nova-compute[75453]: FIRMWARE:
Nov 28 14:11:56 user nova-compute[75453]: No targets found.
Nov 28 14:11:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:11:56 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:11:56 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed6f19a-bc2b-4671-8953-dbbe2742c5ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[175962c9-410d-483a-a949-0c2b1fa88453]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:11:56 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:11:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:11:56 user nova-compute[75453]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 (non-flash)
Nov 28 14:11:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c724280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47'): ({'sdd'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Removing single pathed devices sdd {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a954bcbd-4d26-474d-a067-af3f056be968]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[94563e18-728c-4b1a-853a-fdd8ce290cf2]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flushing IO for device /dev/sdd {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f41142f-57ec-48e7-9623-77763d8d9aef]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deff7c2-8f9e-47e1-b3f5-ca615ecf660a]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[41615724-3939-462b-a499-3a9eff586795]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[20069172-32b9-4717-9780-be4f9f371a4f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260]
Nov 28 14:11:56 user nova-compute[75453]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47, portal: 172.16.0.220,3260] successful.
Nov 28 14:11:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b03b35-b011-46d4-ab6f-2bd994f14c47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f07a75-a49f-409d-ac7a-6bf78cd72ac8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== disconnect_volume: return (316ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:11:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:11:57 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'flavor' on Instance uuid 62c8d241-26ff-431e-98de-56c2941cf895 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:11:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd31-4444-4b09-a1e9-6c23fb18850f tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.719s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "62c8d241-26ff-431e-98de-56c2941cf895" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.193s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "62c8d241-26ff-431e-98de-56c2941cf895" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:58 user nova-compute[75453]: INFO nova.compute.manager [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Terminating instance
Nov 28 14:11:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:11:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received event network-vif-unplugged-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] No waiting events found dispatching network-vif-unplugged-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-344902b4-621a-43c6-aac5-89b2a653a589 req-02675f86-be61-4dc3-81de-3f00b513bd43 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received event network-vif-unplugged-8b8020db-6358-4061-8494-c21f704791fb for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Instance destroyed successfully.
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.objects.instance [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lazy-loading 'resources' on Instance uuid 8ea60b55-d974-4262-9413-37459394f8a6 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-302157245',display_name='tempest-TestMinimumBasicScenario-server-302157245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-302157245',id=31,image_ref='6530f2f4-cb90-4204-90fe-226e4fc806c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa19ae4ZpRTk8W8Dy0ei1mbIqo2DyDhgzSWjJaNvQeFzWl77MekDwIF3aQsbXH5GjTuclZvjusBW70UuFW4tBl6XBUDa/gQEGo6iKrUvg98hB7Vo/QDIUMrAZNkg2P19Q==',key_name='tempest-TestMinimumBasicScenario-61460895',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:06:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4056ca714ed4e85878d7819ef63b20c',ramdisk_id='',reservation_id='r-caeol4fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6530f2f4-cb90-4204-90fe-226e4fc806c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2080131890',owner_user_name='tempest-TestMinimumBasicScenario-2080131890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:06:50Z,user_data=None,user_id='e109047aa8a34d8aad03c6c0dc14c7c8',uuid=8ea60b55-d974-4262-9413-37459394f8a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converting VIF {"id": "8b8020db-6358-4061-8494-c21f704791fb", "address": "fa:16:3e:eb:12:e9", "network": {"id": "ba428b8f-0c0f-4327-be18-5f08025368bf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-205787803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4056ca714ed4e85878d7819ef63b20c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8020db-63", "ovs_interfaceid": "8b8020db-6358-4061-8494-c21f704791fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8b8020db-6358-4061-8494-c21f704791fb,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8020db-63') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG os_vif [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8b8020db-6358-4061-8494-c21f704791fb,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8020db-63') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8020db-63, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5acec7eb-682c-4924-95fd-3a6e3bfa6182) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:11:59 user nova-compute[75453]: INFO os_vif [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8b8020db-6358-4061-8494-c21f704791fb,network=Network(ba428b8f-0c0f-4327-be18-5f08025368bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8020db-63')
Nov 28 14:11:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Deleting instance files /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6_del
Nov 28 14:11:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Deletion of /opt/stack/data/nova/instances/8ea60b55-d974-4262-9413-37459394f8a6_del complete
Nov 28 14:11:59 user nova-compute[75453]: INFO nova.compute.manager [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 28 14:11:59 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:11:59 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Took 0.42 seconds to deallocate network for instance.
Nov 28 14:11:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:11:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:00 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:12:00 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:12:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:00 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Deleted allocations for instance 8ea60b55-d974-4262-9413-37459394f8a6
Nov 28 14:12:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-36ca166f-735d-4a45-a34d-0635a30ff32e tempest-TestMinimumBasicScenario-2080131890 tempest-TestMinimumBasicScenario-2080131890-project-member] Lock "8ea60b55-d974-4262-9413-37459394f8a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.579s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received event network-vif-plugged-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] Acquiring lock "8ea60b55-d974-4262-9413-37459394f8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] Lock "8ea60b55-d974-4262-9413-37459394f8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] No waiting events found dispatching network-vif-plugged-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:01 user nova-compute[75453]: WARNING nova.compute.manager [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received unexpected event network-vif-plugged-8b8020db-6358-4061-8494-c21f704791fb for instance with vm_state deleted and task_state None.
Nov 28 14:12:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-66b05423-fa67-4155-a161-72807aeb8dbc req-379c7c91-a551-44e4-9106-26a7b7b35ac7 service nova] [instance: 8ea60b55-d974-4262-9413-37459394f8a6] Received event network-vif-deleted-8b8020db-6358-4061-8494-c21f704791fb {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:07 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:12:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:12:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:12:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:12:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:12:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:12:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:12:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:12:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:12:17 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:12:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updating instance_info_cache with network_info: [{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:12:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:12:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:21 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:12:21 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8579MB free_disk=25.13976287841797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 62c8d241-26ff-431e-98de-56c2941cf895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:12:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:12:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:12:23 user nova-compute[75453]: INFO nova.compute.claims [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Claim successful on node user
Nov 28 14:12:23 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:12:23 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:12:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:12:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG nova.policy [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8074110936b461690a6518ddee180ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb60c747fc434b8a8bb9a0df65970d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:12:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Creating image(s)
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.198s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk 1073741824" returned: 0 in 0.059s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Successfully created port: 083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Cannot resize image /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Ensure instance console log exists: /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Successfully updated port: 083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquired lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-changed-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Refreshing instance network info cache due to event network-changed-083dcc40-7aec-41be-81b9-aaad0c58aa1f. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] Acquiring lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating instance_info_cache with network_info: [{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Releasing lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance network_info: |[{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] Acquired lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.network.neutron [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Refreshing network info cache for port 083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Start _get_guest_xml network_info=[{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:12:25 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:12:25 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-305119202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-305119202',id=34,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASV6MnUadFAc7iZ7kDsGBeSWBHLx0HiC7FZU6gHt0T9M0U7bXyxZrHTWGaqZr8IRdsSIm5ml9TZaH+JYHyWlY0s7Lsr7RMw0ZMqU1z4TcvE8WrXdZcF+eGNoZGvUAnKNg==',key_name='tempest-keypair-1146512233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-p3df4rdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=ab749a19-fc12-4a97-9a7d-7a5410b2038d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.objects.instance [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'pci_devices' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:12:25 user nova-compute[75453]:   <uuid>ab749a19-fc12-4a97-9a7d-7a5410b2038d</uuid>
Nov 28 14:12:25 user nova-compute[75453]:   <name>instance-00000022</name>
Nov 28 14:12:25 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:12:25 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:12:25 user nova-compute[75453]:   <metadata>
Nov 28 14:12:25 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:12:25 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:12:25 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-305119202</nova:name>
Nov 28 14:12:25 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:12:25</nova:creationTime>
Nov 28 14:12:25 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:12:25 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:12:25 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:12:25 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:12:25 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:12:25 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:12:25 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:12:25 user nova-compute[75453]:       <nova:owner>
Nov 28 14:12:25 user nova-compute[75453]:         <nova:user uuid="e8074110936b461690a6518ddee180ac">tempest-AttachVolumeShelveTestJSON-1619345525-project-member</nova:user>
Nov 28 14:12:25 user nova-compute[75453]:         <nova:project uuid="bb60c747fc434b8a8bb9a0df65970d92">tempest-AttachVolumeShelveTestJSON-1619345525</nova:project>
Nov 28 14:12:25 user nova-compute[75453]:       </nova:owner>
Nov 28 14:12:25 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:12:25 user nova-compute[75453]:       <nova:ports>
Nov 28 14:12:25 user nova-compute[75453]:         <nova:port uuid="083dcc40-7aec-41be-81b9-aaad0c58aa1f">
Nov 28 14:12:25 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 14:12:25 user nova-compute[75453]:         </nova:port>
Nov 28 14:12:25 user nova-compute[75453]:       </nova:ports>
Nov 28 14:12:25 user nova-compute[75453]:     </nova:instance>
Nov 28 14:12:25 user nova-compute[75453]:   </metadata>
Nov 28 14:12:25 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:12:25 user nova-compute[75453]:     <system>
Nov 28 14:12:25 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:12:25 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:12:25 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:12:25 user nova-compute[75453]:       <entry name="serial">ab749a19-fc12-4a97-9a7d-7a5410b2038d</entry>
Nov 28 14:12:25 user nova-compute[75453]:       <entry name="uuid">ab749a19-fc12-4a97-9a7d-7a5410b2038d</entry>
Nov 28 14:12:25 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:12:25 user nova-compute[75453]:     </system>
Nov 28 14:12:25 user nova-compute[75453]:   </sysinfo>
Nov 28 14:12:25 user nova-compute[75453]:   <os>
Nov 28 14:12:25 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:12:25 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:12:25 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:12:25 user nova-compute[75453]:   </os>
Nov 28 14:12:25 user nova-compute[75453]:   <features>
Nov 28 14:12:25 user nova-compute[75453]:     <acpi/>
Nov 28 14:12:25 user nova-compute[75453]:     <apic/>
Nov 28 14:12:25 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:12:25 user nova-compute[75453]:   </features>
Nov 28 14:12:25 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:12:25 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:12:25 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:12:25 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:12:25 user nova-compute[75453]:   </clock>
Nov 28 14:12:25 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:12:25 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:12:25 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:12:25 user nova-compute[75453]:   </cpu>
Nov 28 14:12:25 user nova-compute[75453]:   <devices>
Nov 28 14:12:25 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:12:25 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:12:25 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk"/>
Nov 28 14:12:25 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:12:25 user nova-compute[75453]:     </disk>
Nov 28 14:12:25 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:12:25 user nova-compute[75453]:       <mac address="fa:16:3e:e2:7f:e6"/>
Nov 28 14:12:25 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:12:25 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:12:25 user nova-compute[75453]:       <target dev="tap083dcc40-7a"/>
Nov 28 14:12:25 user nova-compute[75453]:     </interface>
Nov 28 14:12:25 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:12:25 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/console.log" append="off"/>
Nov 28 14:12:25 user nova-compute[75453]:     </serial>
Nov 28 14:12:25 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:12:25 user nova-compute[75453]:     <video>
Nov 28 14:12:25 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:12:25 user nova-compute[75453]:     </video>
Nov 28 14:12:25 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:12:25 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:12:25 user nova-compute[75453]:     </rng>
Nov 28 14:12:25 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:12:25 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:12:25 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:12:25 user nova-compute[75453]:     </memballoon>
Nov 28 14:12:25 user nova-compute[75453]:   </devices>
Nov 28 14:12:25 user nova-compute[75453]: </domain>
Nov 28 14:12:25 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-305119202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-305119202',id=34,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASV6MnUadFAc7iZ7kDsGBeSWBHLx0HiC7FZU6gHt0T9M0U7bXyxZrHTWGaqZr8IRdsSIm5ml9TZaH+JYHyWlY0s7Lsr7RMw0ZMqU1z4TcvE8WrXdZcF+eGNoZGvUAnKNg==',key_name='tempest-keypair-1146512233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-p3df4rdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=ab749a19-fc12-4a97-9a7d-7a5410b2038d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG os_vif [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43d84ae8-32c0-5815-acbc-71fae9e45ee7', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap083dcc40-7a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap083dcc40-7a, col_values=(('qos', UUID('6cc7ca9b-fc2d-41ee-ae4a-964e50c85890')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap083dcc40-7a, col_values=(('external_ids', {'iface-id': '083dcc40-7aec-41be-81b9-aaad0c58aa1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:7f:e6', 'vm-uuid': 'ab749a19-fc12-4a97-9a7d-7a5410b2038d'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:25 user nova-compute[75453]: INFO nova.compute.manager [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Terminating instance
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:25 user nova-compute[75453]: INFO os_vif [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a')
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] No VIF found with MAC fa:16:3e:e2:7f:e6, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:12:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updated VIF entry in instance network info cache for port 083dcc40-7aec-41be-81b9-aaad0c58aa1f. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG nova.network.neutron [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating instance_info_cache with network_info: [{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a72e1911-2691-4da5-8109-11bc79cfd6b5 req-2be52598-6bbe-4dc8-a6df-6b369fd7bcf8 service nova] Releasing lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Instance destroyed successfully.
Nov 28 14:12:26 user nova-compute[75453]: DEBUG nova.objects.instance [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'resources' on Instance uuid 62c8d241-26ff-431e-98de-56c2941cf895 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1682840901',display_name='tempest-ServerActionsTestOtherA-server-1998050807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1682840901',id=30,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXwEXKVXgWWKg7f1++x+TJXhG7IKT/xO+VHfqjWh6vTLUqjBHnnqIN9BD48DwKAR5bFvefKT51EUFBNmqbL89LQSkNMn22MOEyL4az1iMY6GaI68+ZEUNFcu40O71nmtw==',key_name='tempest-keypair-1093862542',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:09:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-gj7iwpw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:09:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=62c8d241-26ff-431e-98de-56c2941cf895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "90875e2b-ad20-4e71-903c-08ab27b78d96", "address": "fa:16:3e:1f:0b:54", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90875e2b-ad", "ovs_interfaceid": "90875e2b-ad20-4e71-903c-08ab27b78d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG os_vif [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90875e2b-ad, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=860944cc-eebe-4ec4-9c7d-5c639583fe00) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: INFO os_vif [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=90875e2b-ad20-4e71-903c-08ab27b78d96,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90875e2b-ad')
Nov 28 14:12:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Deleting instance files /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895_del
Nov 28 14:12:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Deletion of /opt/stack/data/nova/instances/62c8d241-26ff-431e-98de-56c2941cf895_del complete
Nov 28 14:12:27 user nova-compute[75453]: INFO nova.compute.manager [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-unplugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-unplugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-unplugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:27 user nova-compute[75453]: WARNING nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state active and task_state deleting.
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:27 user nova-compute[75453]: WARNING nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state active and task_state deleting.
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:27 user nova-compute[75453]: WARNING nova.compute.manager [req-8655ad1c-9695-4493-bf86-1afe01af6d1e req-c131b6ab-3e34-4268-a1f5-7ecd95dea872 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state active and task_state deleting.
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:28 user nova-compute[75453]: WARNING nova.compute.manager [req-e438d411-9204-4e21-a3f0-c020f124788b req-bc7a2758-0159-4a20-a5ce-3fc64db8b822 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state building and task_state spawning.
Nov 28 14:12:28 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:12:28 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Took 1.27 seconds to deallocate network for instance.
Nov 28 14:12:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:12:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:28 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Deleted allocations for instance 62c8d241-26ff-431e-98de-56c2941cf895
Nov 28 14:12:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7326c8eb-2a87-40ef-af27-da5a53b77445 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "62c8d241-26ff-431e-98de-56c2941cf895" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-unplugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-unplugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:29 user nova-compute[75453]: WARNING nova.compute.manager [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-unplugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state deleted and task_state None.
Nov 28 14:12:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Acquiring lock "62c8d241-26ff-431e-98de-56c2941cf895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] Lock "62c8d241-26ff-431e-98de-56c2941cf895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] No waiting events found dispatching network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:29 user nova-compute[75453]: WARNING nova.compute.manager [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received unexpected event network-vif-plugged-90875e2b-ad20-4e71-903c-08ab27b78d96 for instance with vm_state deleted and task_state None.
Nov 28 14:12:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-d91c438d-771b-413c-8b99-a42a99336fd4 req-ddd61705-de5a-4ceb-9ca5-fc6cd7d48893 service nova] [instance: 62c8d241-26ff-431e-98de-56c2941cf895] Received event network-vif-deleted-90875e2b-ad20-4e71-903c-08ab27b78d96 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:12:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:12:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance spawned successfully.
Nov 28 14:12:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:30 user nova-compute[75453]: INFO nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 28 14:12:30 user nova-compute[75453]: DEBUG nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:30 user nova-compute[75453]: WARNING nova.compute.manager [req-3a2e2971-4500-4c1e-b4ab-95b128f42936 req-c25693c5-1dd3-4307-8bca-24496ab5ab16 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state building and task_state spawning.
Nov 28 14:12:30 user nova-compute[75453]: INFO nova.compute.manager [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Took 6.57 seconds to build instance.
Nov 28 14:12:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-3561694b-dbbe-440c-be00-1c65a8fbda6c tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.675s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "5b829120-ebe1-42d0-8875-e580f38b397c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "5b829120-ebe1-42d0-8875-e580f38b397c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:12:33 user nova-compute[75453]: INFO nova.compute.claims [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Claim successful on node user
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:12:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:12:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Creating image(s)
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "/opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "/opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG nova.policy [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0e78e1f355b413d821a1d11223911d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08f31bef3a34d76b4d792b4f57841ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.227s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk 1073741824" returned: 0 in 0.054s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Cannot resize image /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Ensure instance console log exists: /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:34 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Successfully created port: a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Successfully updated port: a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "refresh_cache-5b829120-ebe1-42d0-8875-e580f38b397c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquired lock "refresh_cache-5b829120-ebe1-42d0-8875-e580f38b397c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received event network-changed-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Refreshing instance network info cache due to event network-changed-a99acb2d-6700-4f26-be76-21e54b5d700d. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] Acquiring lock "refresh_cache-5b829120-ebe1-42d0-8875-e580f38b397c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Updating instance_info_cache with network_info: [{"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Releasing lock "refresh_cache-5b829120-ebe1-42d0-8875-e580f38b397c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Instance network_info: |[{"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] Acquired lock "refresh_cache-5b829120-ebe1-42d0-8875-e580f38b397c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Refreshing network info cache for port a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Start _get_guest_xml network_info=[{"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:12:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:12:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1310594149',display_name='tempest-VolumesNegativeTest-instance-1310594149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1310594149',id=35,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d08f31bef3a34d76b4d792b4f57841ac',ramdisk_id='',reservation_id='r-ckvvkl9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-543955992',owner_user_name='tempest-VolumesNegativeTest-543955992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:12:34Z,user_data=None,user_id='d0e78e1f355b413d821a1d11223911d8',uuid=5b829120-ebe1-42d0-8875-e580f38b397c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Converting VIF {"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:23,bridge_name='br-int',has_traffic_filtering=True,id=a99acb2d-6700-4f26-be76-21e54b5d700d,network=Network(71014945-f614-483e-b0f8-ed5bed26bfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99acb2d-67') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b829120-ebe1-42d0-8875-e580f38b397c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:12:35 user nova-compute[75453]:   <uuid>5b829120-ebe1-42d0-8875-e580f38b397c</uuid>
Nov 28 14:12:35 user nova-compute[75453]:   <name>instance-00000023</name>
Nov 28 14:12:35 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:12:35 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:12:35 user nova-compute[75453]:   <metadata>
Nov 28 14:12:35 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:12:35 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:12:35 user nova-compute[75453]:       <nova:name>tempest-VolumesNegativeTest-instance-1310594149</nova:name>
Nov 28 14:12:35 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:12:35</nova:creationTime>
Nov 28 14:12:35 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:12:35 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:12:35 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:12:35 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:12:35 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:12:35 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:12:35 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:12:35 user nova-compute[75453]:       <nova:owner>
Nov 28 14:12:35 user nova-compute[75453]:         <nova:user uuid="d0e78e1f355b413d821a1d11223911d8">tempest-VolumesNegativeTest-543955992-project-member</nova:user>
Nov 28 14:12:35 user nova-compute[75453]:         <nova:project uuid="d08f31bef3a34d76b4d792b4f57841ac">tempest-VolumesNegativeTest-543955992</nova:project>
Nov 28 14:12:35 user nova-compute[75453]:       </nova:owner>
Nov 28 14:12:35 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:12:35 user nova-compute[75453]:       <nova:ports>
Nov 28 14:12:35 user nova-compute[75453]:         <nova:port uuid="a99acb2d-6700-4f26-be76-21e54b5d700d">
Nov 28 14:12:35 user nova-compute[75453]:           <nova:ip type="fixed" address="192.168.233.181" ipVersion="4"/>
Nov 28 14:12:35 user nova-compute[75453]:         </nova:port>
Nov 28 14:12:35 user nova-compute[75453]:       </nova:ports>
Nov 28 14:12:35 user nova-compute[75453]:     </nova:instance>
Nov 28 14:12:35 user nova-compute[75453]:   </metadata>
Nov 28 14:12:35 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:12:35 user nova-compute[75453]:     <system>
Nov 28 14:12:35 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:12:35 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:12:35 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:12:35 user nova-compute[75453]:       <entry name="serial">5b829120-ebe1-42d0-8875-e580f38b397c</entry>
Nov 28 14:12:35 user nova-compute[75453]:       <entry name="uuid">5b829120-ebe1-42d0-8875-e580f38b397c</entry>
Nov 28 14:12:35 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:12:35 user nova-compute[75453]:     </system>
Nov 28 14:12:35 user nova-compute[75453]:   </sysinfo>
Nov 28 14:12:35 user nova-compute[75453]:   <os>
Nov 28 14:12:35 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:12:35 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:12:35 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:12:35 user nova-compute[75453]:   </os>
Nov 28 14:12:35 user nova-compute[75453]:   <features>
Nov 28 14:12:35 user nova-compute[75453]:     <acpi/>
Nov 28 14:12:35 user nova-compute[75453]:     <apic/>
Nov 28 14:12:35 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:12:35 user nova-compute[75453]:   </features>
Nov 28 14:12:35 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:12:35 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:12:35 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:12:35 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:12:35 user nova-compute[75453]:   </clock>
Nov 28 14:12:35 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:12:35 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:12:35 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:12:35 user nova-compute[75453]:   </cpu>
Nov 28 14:12:35 user nova-compute[75453]:   <devices>
Nov 28 14:12:35 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:12:35 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:12:35 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk"/>
Nov 28 14:12:35 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:12:35 user nova-compute[75453]:     </disk>
Nov 28 14:12:35 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:12:35 user nova-compute[75453]:       <mac address="fa:16:3e:53:b2:23"/>
Nov 28 14:12:35 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:12:35 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:12:35 user nova-compute[75453]:       <target dev="tapa99acb2d-67"/>
Nov 28 14:12:35 user nova-compute[75453]:     </interface>
Nov 28 14:12:35 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:12:35 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/console.log" append="off"/>
Nov 28 14:12:35 user nova-compute[75453]:     </serial>
Nov 28 14:12:35 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:12:35 user nova-compute[75453]:     <video>
Nov 28 14:12:35 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:12:35 user nova-compute[75453]:     </video>
Nov 28 14:12:35 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:12:35 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:12:35 user nova-compute[75453]:     </rng>
Nov 28 14:12:35 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:12:35 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:12:35 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:12:35 user nova-compute[75453]:     </memballoon>
Nov 28 14:12:35 user nova-compute[75453]:   </devices>
Nov 28 14:12:35 user nova-compute[75453]: </domain>
Nov 28 14:12:35 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1310594149',display_name='tempest-VolumesNegativeTest-instance-1310594149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1310594149',id=35,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d08f31bef3a34d76b4d792b4f57841ac',ramdisk_id='',reservation_id='r-ckvvkl9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-543955992',owner_user_name='tempest-VolumesNegativeTest-543955992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:12:34Z,user_data=None,user_id='d0e78e1f355b413d821a1d11223911d8',uuid=5b829120-ebe1-42d0-8875-e580f38b397c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Converting VIF {"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:23,bridge_name='br-int',has_traffic_filtering=True,id=a99acb2d-6700-4f26-be76-21e54b5d700d,network=Network(71014945-f614-483e-b0f8-ed5bed26bfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99acb2d-67') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG os_vif [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:23,bridge_name='br-int',has_traffic_filtering=True,id=a99acb2d-6700-4f26-be76-21e54b5d700d,network=Network(71014945-f614-483e-b0f8-ed5bed26bfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99acb2d-67') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '357648ce-baf7-5b7e-a806-923c35fc6426', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa99acb2d-67, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa99acb2d-67, col_values=(('qos', UUID('99235d27-0be2-4ee0-a75b-96a4c76b0ea7')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa99acb2d-67, col_values=(('external_ids', {'iface-id': 'a99acb2d-6700-4f26-be76-21e54b5d700d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:b2:23', 'vm-uuid': '5b829120-ebe1-42d0-8875-e580f38b397c'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:35 user nova-compute[75453]: INFO os_vif [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:23,bridge_name='br-int',has_traffic_filtering=True,id=a99acb2d-6700-4f26-be76-21e54b5d700d,network=Network(71014945-f614-483e-b0f8-ed5bed26bfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99acb2d-67')
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] No VIF found with MAC fa:16:3e:53:b2:23, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Updated VIF entry in instance network info cache for port a99acb2d-6700-4f26-be76-21e54b5d700d. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG nova.network.neutron [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Updating instance_info_cache with network_info: [{"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:12:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-79f17816-6496-4944-8382-f2aa1d5183d9 req-bde07191-a050-4286-b33a-cde087e7b13b service nova] Releasing lock "refresh_cache-5b829120-ebe1-42d0-8875-e580f38b397c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:12:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:37 user nova-compute[75453]: DEBUG nova.compute.manager [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received event network-vif-plugged-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] Acquiring lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:37 user nova-compute[75453]: DEBUG nova.compute.manager [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] No waiting events found dispatching network-vif-plugged-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:37 user nova-compute[75453]: WARNING nova.compute.manager [req-d2c424a8-e8b9-4c9b-97c0-5772b09dd37d req-60544f55-cc92-4a0b-83a5-cd1cbdb885b1 service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received unexpected event network-vif-plugged-a99acb2d-6700-4f26-be76-21e54b5d700d for instance with vm_state building and task_state spawning.
Nov 28 14:12:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:12:38 user nova-compute[75453]: INFO nova.compute.claims [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Claim successful on node user
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:12:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.policy [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:12:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Creating image(s)
Nov 28 14:12:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "/opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "/opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "/opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk 1073741824" returned: 0 in 0.062s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received event network-vif-plugged-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] Acquiring lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] No waiting events found dispatching network-vif-plugged-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:39 user nova-compute[75453]: WARNING nova.compute.manager [req-952cd497-ff0d-495a-ac54-4d42775643ee req-dc379263-bacc-46e5-a861-a2ab98ec955f service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received unexpected event network-vif-plugged-a99acb2d-6700-4f26-be76-21e54b5d700d for instance with vm_state building and task_state spawning.
Nov 28 14:12:39 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Instance spawned successfully.
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Successfully created port: 54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:12:39 user nova-compute[75453]: INFO nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:12:39 user nova-compute[75453]: INFO nova.compute.manager [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Took 6.61 seconds to build instance.
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d0db6ea2-9454-42d7-85be-1af6994de9c1 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "5b829120-ebe1-42d0-8875-e580f38b397c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.730s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Cannot resize image /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Ensure instance console log exists: /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Successfully updated port: 54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.compute.manager [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received event network-changed-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.compute.manager [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Refreshing instance network info cache due to event network-changed-54df673e-4fe7-4894-b18f-ed5dc483d516. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] Acquiring lock "refresh_cache-eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] Acquired lock "refresh_cache-eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Refreshing network info cache for port 54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "refresh_cache-eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d7fff31a-1889-4de8-b0df-756565bb3b00 req-a223d6b3-9140-4b6b-8c3c-edd304ce4d58 service nova] Releasing lock "refresh_cache-eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquired lock "refresh_cache-eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Updating instance_info_cache with network_info: [{"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Releasing lock "refresh_cache-eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Instance network_info: |[{"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Start _get_guest_xml network_info=[{"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:12:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:12:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1916015322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1916015322',id=36,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-mabzn0p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:12:39Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=54df673e-4fe7-4894-b18f-ed5dc483d516,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54df673e-4f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.objects.instance [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'pci_devices' on Instance uuid eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:12:40 user nova-compute[75453]:   <uuid>eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0</uuid>
Nov 28 14:12:40 user nova-compute[75453]:   <name>instance-00000024</name>
Nov 28 14:12:40 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:12:40 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:12:40 user nova-compute[75453]:   <metadata>
Nov 28 14:12:40 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:12:40 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:12:40 user nova-compute[75453]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1916015322</nova:name>
Nov 28 14:12:40 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:12:40</nova:creationTime>
Nov 28 14:12:40 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:12:40 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:12:40 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:12:40 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:12:40 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:12:40 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:12:40 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:12:40 user nova-compute[75453]:       <nova:owner>
Nov 28 14:12:40 user nova-compute[75453]:         <nova:user uuid="f88c92554f0f44b0be661aa40aec8670">tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member</nova:user>
Nov 28 14:12:40 user nova-compute[75453]:         <nova:project uuid="3de3b398da714d8cb92fad7f64d5c64e">tempest-ServerBootFromVolumeStableRescueTest-682344680</nova:project>
Nov 28 14:12:40 user nova-compute[75453]:       </nova:owner>
Nov 28 14:12:40 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:12:40 user nova-compute[75453]:       <nova:ports>
Nov 28 14:12:40 user nova-compute[75453]:         <nova:port uuid="54df673e-4fe7-4894-b18f-ed5dc483d516">
Nov 28 14:12:40 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 14:12:40 user nova-compute[75453]:         </nova:port>
Nov 28 14:12:40 user nova-compute[75453]:       </nova:ports>
Nov 28 14:12:40 user nova-compute[75453]:     </nova:instance>
Nov 28 14:12:40 user nova-compute[75453]:   </metadata>
Nov 28 14:12:40 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:12:40 user nova-compute[75453]:     <system>
Nov 28 14:12:40 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:12:40 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:12:40 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:12:40 user nova-compute[75453]:       <entry name="serial">eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0</entry>
Nov 28 14:12:40 user nova-compute[75453]:       <entry name="uuid">eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0</entry>
Nov 28 14:12:40 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:12:40 user nova-compute[75453]:     </system>
Nov 28 14:12:40 user nova-compute[75453]:   </sysinfo>
Nov 28 14:12:40 user nova-compute[75453]:   <os>
Nov 28 14:12:40 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:12:40 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:12:40 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:12:40 user nova-compute[75453]:   </os>
Nov 28 14:12:40 user nova-compute[75453]:   <features>
Nov 28 14:12:40 user nova-compute[75453]:     <acpi/>
Nov 28 14:12:40 user nova-compute[75453]:     <apic/>
Nov 28 14:12:40 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:12:40 user nova-compute[75453]:   </features>
Nov 28 14:12:40 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:12:40 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:12:40 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:12:40 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:12:40 user nova-compute[75453]:   </clock>
Nov 28 14:12:40 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:12:40 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:12:40 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:12:40 user nova-compute[75453]:   </cpu>
Nov 28 14:12:40 user nova-compute[75453]:   <devices>
Nov 28 14:12:40 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:12:40 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:12:40 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk"/>
Nov 28 14:12:40 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:12:40 user nova-compute[75453]:     </disk>
Nov 28 14:12:40 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:12:40 user nova-compute[75453]:       <mac address="fa:16:3e:33:d7:02"/>
Nov 28 14:12:40 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:12:40 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:12:40 user nova-compute[75453]:       <target dev="tap54df673e-4f"/>
Nov 28 14:12:40 user nova-compute[75453]:     </interface>
Nov 28 14:12:40 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:12:40 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/console.log" append="off"/>
Nov 28 14:12:40 user nova-compute[75453]:     </serial>
Nov 28 14:12:40 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:12:40 user nova-compute[75453]:     <video>
Nov 28 14:12:40 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:12:40 user nova-compute[75453]:     </video>
Nov 28 14:12:40 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:12:40 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:12:40 user nova-compute[75453]:     </rng>
Nov 28 14:12:40 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:12:40 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:12:40 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:12:40 user nova-compute[75453]:     </memballoon>
Nov 28 14:12:40 user nova-compute[75453]:   </devices>
Nov 28 14:12:40 user nova-compute[75453]: </domain>
Nov 28 14:12:40 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1916015322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1916015322',id=36,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-mabzn0p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:12:39Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=54df673e-4fe7-4894-b18f-ed5dc483d516,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54df673e-4f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG os_vif [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=54df673e-4fe7-4894-b18f-ed5dc483d516,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54df673e-4f') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc9e7c90-6314-5412-ad03-ed88874e0d86', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54df673e-4f, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54df673e-4f, col_values=(('qos', UUID('f89f38af-b9e0-4fa9-8c67-35408b58dea5')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54df673e-4f, col_values=(('external_ids', {'iface-id': '54df673e-4fe7-4894-b18f-ed5dc483d516', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:d7:02', 'vm-uuid': 'eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:40 user nova-compute[75453]: INFO os_vif [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=54df673e-4fe7-4894-b18f-ed5dc483d516,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54df673e-4f')
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:12:40 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No VIF found with MAC fa:16:3e:33:d7:02, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:12:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received event network-vif-plugged-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] Acquiring lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] No waiting events found dispatching network-vif-plugged-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:42 user nova-compute[75453]: WARNING nova.compute.manager [req-5e6070e1-417a-4f2d-9642-16c0a838b4ee req-856d454d-0d10-48e0-9b66-1d7b956486bf service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received unexpected event network-vif-plugged-54df673e-4fe7-4894-b18f-ed5dc483d516 for instance with vm_state building and task_state spawning.
Nov 28 14:12:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received event network-vif-plugged-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] Acquiring lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] No waiting events found dispatching network-vif-plugged-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:12:44 user nova-compute[75453]: WARNING nova.compute.manager [req-daf99913-259c-4f93-b84d-121156f444be req-35ac7bf0-3443-4c87-8322-48206b115a69 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received unexpected event network-vif-plugged-54df673e-4fe7-4894-b18f-ed5dc483d516 for instance with vm_state building and task_state spawning.
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:12:44 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Instance spawned successfully.
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:12:44 user nova-compute[75453]: INFO nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 28 14:12:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:12:44 user nova-compute[75453]: INFO nova.compute.manager [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Took 6.51 seconds to build instance.
Nov 28 14:12:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9a57ce94-ca2a-4c80-9112-613045e6aae2 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.611s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:12:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:12:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:14 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:13:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:13:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:13:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:21 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:13:23 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:13:23 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8323MB free_disk=25.109066009521484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance ab749a19-fc12-4a97-9a7d-7a5410b2038d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 5b829120-ebe1-42d0-8875-e580f38b397c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:13:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:13:24 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:13:24 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:13:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:13:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:13:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:13:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:13:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:13:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:13:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:13:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:14:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:14 user nova-compute[75453]: DEBUG nova.compute.manager [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-changed-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:14 user nova-compute[75453]: DEBUG nova.compute.manager [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Refreshing instance network info cache due to event network-changed-083dcc40-7aec-41be-81b9-aaad0c58aa1f. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:14:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] Acquiring lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:14:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] Acquired lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:14:14 user nova-compute[75453]: DEBUG nova.network.neutron [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Refreshing network info cache for port 083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:14:14 user nova-compute[75453]: DEBUG nova.network.neutron [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updated VIF entry in instance network info cache for port 083dcc40-7aec-41be-81b9-aaad0c58aa1f. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:14:14 user nova-compute[75453]: DEBUG nova.network.neutron [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating instance_info_cache with network_info: [{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:14:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f4dd5903-6ad3-4e61-a9ac-2d1b5a0636e1 req-6b9e1294-35bc-42fe-ac13-f850d9695152 service nova] Releasing lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:14:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:14:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:14:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:14:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:18 user nova-compute[75453]: INFO nova.compute.manager [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Shelving
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-unplugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-unplugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:18 user nova-compute[75453]: WARNING nova.compute.manager [req-acab7502-26e5-499b-bc5a-95c08bd760b3 req-57d264ec-45be-419b-94f9-238b61c5ccb6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-unplugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state active and task_state shelving.
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance destroyed successfully.
Nov 28 14:14:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:18 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Beginning cold snapshot process
Nov 28 14:14:19 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk /opt/stack/data/nova/instances/snapshots/tmpcjg84lr4/6ac0059299e54e478a2b589885ca1b59 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid b531830d-1e76-4b07-bed1-2b009e235382 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk /opt/stack/data/nova/instances/snapshots/tmpcjg84lr4/6ac0059299e54e478a2b589885ca1b59" returned: 0 in 0.597s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:19 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Snapshot extracted, beginning image upload
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updating instance_info_cache with network_info: [{"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:20 user nova-compute[75453]: WARNING nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:20 user nova-compute[75453]: WARNING nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:20 user nova-compute[75453]: WARNING nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-unplugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-unplugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:20 user nova-compute[75453]: WARNING nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-unplugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:20 user nova-compute[75453]: WARNING nova.compute.manager [req-a194f745-abfd-43df-9bdd-e52464c4d8ba req-9e7c0dda-486d-483f-b507-302746996ed5 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 14:14:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Snapshot image upload complete
Nov 28 14:14:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:14:22 user nova-compute[75453]: INFO nova.compute.manager [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Shelve offloading
Nov 28 14:14:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance destroyed successfully.
Nov 28 14:14:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquired lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating instance_info_cache with network_info: [{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Releasing lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "5b829120-ebe1-42d0-8875-e580f38b397c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "5b829120-ebe1-42d0-8875-e580f38b397c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:23 user nova-compute[75453]: INFO nova.compute.manager [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Terminating instance
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-changed-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Refreshing instance network info cache due to event network-changed-083dcc40-7aec-41be-81b9-aaad0c58aa1f. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] Acquiring lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] Acquired lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.network.neutron [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Refreshing network info cache for port 083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received event network-vif-unplugged-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] Acquiring lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] No waiting events found dispatching network-vif-unplugged-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-1013cb02-c92e-4e7b-8daa-b0d708ccd130 req-fea43364-7c89-4f82-8d50-ca62570a1e4d service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received event network-vif-unplugged-a99acb2d-6700-4f26-be76-21e54b5d700d for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.519s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance destroyed successfully.
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'resources' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-305119202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-305119202',id=34,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASV6MnUadFAc7iZ7kDsGBeSWBHLx0HiC7FZU6gHt0T9M0U7bXyxZrHTWGaqZr8IRdsSIm5ml9TZaH+JYHyWlY0s7Lsr7RMw0ZMqU1z4TcvE8WrXdZcF+eGNoZGvUAnKNg==',key_name='tempest-keypair-1146512233',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:12:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-p3df4rdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member',shelved_at='2023-11-28T14:14:22.084391',shelved_host='user',shelved_image_id='8c21cadc-efca-4e7d-8f48-252ccd094f62'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:14:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=ab749a19-fc12-4a97-9a7d-7a5410b2038d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG os_vif [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap083dcc40-7a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cc7ca9b-fc2d-41ee-ae4a-964e50c85890) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: INFO os_vif [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a')
Nov 28 14:14:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Deleting instance files /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d_del
Nov 28 14:14:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Deletion of /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d_del complete
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:23 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000022, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:23 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Deleted allocations for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d
Nov 28 14:14:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Instance destroyed successfully.
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.objects.instance [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lazy-loading 'resources' on Instance uuid 5b829120-ebe1-42d0-8875-e580f38b397c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1310594149',display_name='tempest-VolumesNegativeTest-instance-1310594149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1310594149',id=35,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:12:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d08f31bef3a34d76b4d792b4f57841ac',ramdisk_id='',reservation_id='r-ckvvkl9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-543955992',owner_user_name='tempest-VolumesNegativeTest-543955992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:12:40Z,user_data=None,user_id='d0e78e1f355b413d821a1d11223911d8',uuid=5b829120-ebe1-42d0-8875-e580f38b397c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Converting VIF {"id": "a99acb2d-6700-4f26-be76-21e54b5d700d", "address": "fa:16:3e:53:b2:23", "network": {"id": "71014945-f614-483e-b0f8-ed5bed26bfaf", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "55c8b5e4f96f44279c991fc8a3754674", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99acb2d-67", "ovs_interfaceid": "a99acb2d-6700-4f26-be76-21e54b5d700d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:23,bridge_name='br-int',has_traffic_filtering=True,id=a99acb2d-6700-4f26-be76-21e54b5d700d,network=Network(71014945-f614-483e-b0f8-ed5bed26bfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99acb2d-67') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG os_vif [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:23,bridge_name='br-int',has_traffic_filtering=True,id=a99acb2d-6700-4f26-be76-21e54b5d700d,network=Network(71014945-f614-483e-b0f8-ed5bed26bfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99acb2d-67') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa99acb2d-67, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99235d27-0be2-4ee0-a75b-96a4c76b0ea7) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:14:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:23 user nova-compute[75453]: INFO os_vif [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:23,bridge_name='br-int',has_traffic_filtering=True,id=a99acb2d-6700-4f26-be76-21e54b5d700d,network=Network(71014945-f614-483e-b0f8-ed5bed26bfaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99acb2d-67')
Nov 28 14:14:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Deleting instance files /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c_del
Nov 28 14:14:23 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Deletion of /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c_del complete
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'numa_topology' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.objects.base [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<ab749a19-fc12-4a97-9a7d-7a5410b2038d> lazy-loaded attributes: resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk --force-share --output=json" returned: 1 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk --force-share --output=json' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:14:24 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000023, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/5b829120-ebe1-42d0-8875-e580f38b397c/disk
Nov 28 14:14:24 user nova-compute[75453]: INFO nova.compute.manager [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.network.neutron [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updated VIF entry in instance network info cache for port 083dcc40-7aec-41be-81b9-aaad0c58aa1f. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.network.neutron [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating instance_info_cache with network_info: [{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap083dcc40-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-61d68427-13d2-4278-88be-c1dd2212bcec req-b07bb635-a461-4cd6-8b98-c5b9510c2016 service nova] Releasing lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6e512f7a-b2e8-4ea3-9579-9c9a8708c05f tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.346s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:14:24 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:14:24 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8564MB free_disk=25.059078216552734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:14:24 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Took 0.80 seconds to deallocate network for instance.
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 5b829120-ebe1-42d0-8875-e580f38b397c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:14:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.361s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:14:25 user nova-compute[75453]: INFO nova.compute.claims [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Claim successful on node user
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received event network-vif-plugged-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] Acquiring lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] Lock "5b829120-ebe1-42d0-8875-e580f38b397c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] No waiting events found dispatching network-vif-plugged-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:25 user nova-compute[75453]: WARNING nova.compute.manager [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received unexpected event network-vif-plugged-a99acb2d-6700-4f26-be76-21e54b5d700d for instance with vm_state deleted and task_state None.
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-7298398e-908f-4e9c-8259-a23f66e85bea req-e86fa330-87c8-43fe-a1be-14c447a96117 service nova] [instance: 5b829120-ebe1-42d0-8875-e580f38b397c] Received event network-vif-deleted-a99acb2d-6700-4f26-be76-21e54b5d700d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.680s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:14:25 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.policy [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f84ee8a311d4619b7d51c2066d4775f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ab030af40f43e28b5f1b7ce64c50a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:14:25 user nova-compute[75453]: INFO nova.virt.block_device [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Booting with volume ffa8b858-5204-4333-a839-2d585c38b878 at /dev/vda
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG os_brick.utils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cb09d5-27d2-41c1-aa28-669d052c16a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c5f550-c034-416d-b032-95f7288e9080]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:25 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Deleted allocations for instance 5b829120-ebe1-42d0-8875-e580f38b397c
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.077s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7b6a8d-186b-42f9-a455-6911f7be626b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe83fcc-661d-4bc5-9b7d-634a54c7c0b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-078f8836-610c-4343-93b4-e6c77db47391 tempest-VolumesNegativeTest-543955992 tempest-VolumesNegativeTest-543955992-project-member] Lock "5b829120-ebe1-42d0-8875-e580f38b397c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.931s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:14:26 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:14:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6940b0de-07a1-4af3-84ec-04d81f068d29]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG os_brick.utils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating existing volume attachment record: 9745d13c-2066-4bc2-aa93-d3604ef532b2 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:14:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Successfully created port: 8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Successfully updated port: 8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquired lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating instance_info_cache with network_info: [{"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Releasing lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Instance network_info: |[{"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-changed-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Refreshing instance network info cache due to event network-changed-8ffe4343-b471-4fba-bd3b-676b3653941d. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] Acquiring lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] Acquired lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Refreshing network info cache for port 8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updated VIF entry in instance network info cache for port 8ffe4343-b471-4fba-bd3b-676b3653941d. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG nova.network.neutron [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating instance_info_cache with network_info: [{"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:14:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f33c6ccc-3f1d-4d94-ba5a-36edac9ee636 req-4a6ba2b3-4693-4a5d-bb66-c27bfdbd4d5e service nova] Releasing lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:14:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:29 user nova-compute[75453]: DEBUG nova.compute.manager [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:14:29 user nova-compute[75453]: INFO nova.compute.manager [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] instance snapshotting
Nov 28 14:14:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Beginning live snapshot process
Nov 28 14:14:29 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:14:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json -f qcow2 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json -f qcow2 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.168s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfol74bfm/29cb13cfc11a439ba149a51949c4a051.delta 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfol74bfm/29cb13cfc11a439ba149a51949c4a051.delta 1073741824" returned: 0 in 0.053s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:30 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 14:14:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 14:14:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 14:14:31 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 14:14:31 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:14:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfol74bfm/29cb13cfc11a439ba149a51949c4a051.delta /opt/stack/data/nova/instances/snapshots/tmpfol74bfm/29cb13cfc11a439ba149a51949c4a051 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfol74bfm/29cb13cfc11a439ba149a51949c4a051.delta /opt/stack/data/nova/instances/snapshots/tmpfol74bfm/29cb13cfc11a439ba149a51949c4a051" returned: 0 in 0.552s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:32 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Snapshot extracted, beginning image upload
Nov 28 14:14:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:14:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Creating image(s)
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Ensure instance console log exists: /opt/stack/data/nova/instances/9f9d0178-d8cd-4d99-930f-7d2f787e899a/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Start _get_guest_xml network_info=[{"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9745d13c-2066-4bc2-aa93-d3604ef532b2', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGMlvmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f9d0178-d8cd-4d99-930f-7d2f787e899a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffa8b858-5204-4333-a839-2d585c38b878', 'serial': 'ffa8b858-5204-4333-a839-2d585c38b878'}, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:14:33 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:14:33 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGMlvmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:14:33 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:14:33 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:14:33 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e409bc-3900-417f-a522-60ddc651219e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:14:33 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcec1e81-bfa0-42b8-afda-bcd343e3a85f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878] added
Nov 28 14:14:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a19db2c-d365-4782-a22b-c1a279e7b10d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[840ee815-bf60-437f-9b82-81ba7d3186ec]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUGMlvmr {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUGMlvmr" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a98fc1-319f-4fbd-a5fd-d44d72d1e912]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUGMlvmr'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e91014b-10d1-4c02-9005-e56abcb6d24d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e071e680-33f0-48d0-afa6-f1181ee9254d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:14:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:14:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd84a231-fdb0-42ec-9d62-1544a5ca50d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260]
Nov 28 14:14:33 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260] successful.
Nov 28 14:14:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c5d85e-7e2d-4d76-bf06-681dfbe6d427]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8b1b15-2c04-43b5-bf34-7eeeed85f587]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:14:33 user nova-compute[75453]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:14:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:14:33 user nova-compute[75453]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:14:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a21d405-92c9-4163-a6d7-556c72f16c8f]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGMlvmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:14:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23935616534343031', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935616534343031', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1596818341',display_name='tempest-ServerActionsTestOtherA-server-1596818341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1596818341',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g==',key_name='tempest-keypair-1318751346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-s73uintr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=9f9d0178-d8cd-4d99-930f-7d2f787e899a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.objects.instance [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f9d0178-d8cd-4d99-930f-7d2f787e899a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:14:34 user nova-compute[75453]:   <uuid>9f9d0178-d8cd-4d99-930f-7d2f787e899a</uuid>
Nov 28 14:14:34 user nova-compute[75453]:   <name>instance-00000025</name>
Nov 28 14:14:34 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:14:34 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:14:34 user nova-compute[75453]:   <metadata>
Nov 28 14:14:34 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:14:34 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:14:34 user nova-compute[75453]:       <nova:name>tempest-ServerActionsTestOtherA-server-1596818341</nova:name>
Nov 28 14:14:34 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:14:33</nova:creationTime>
Nov 28 14:14:34 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:14:34 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:14:34 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:14:34 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:14:34 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:14:34 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:14:34 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:14:34 user nova-compute[75453]:       <nova:owner>
Nov 28 14:14:34 user nova-compute[75453]:         <nova:user uuid="9f84ee8a311d4619b7d51c2066d4775f">tempest-ServerActionsTestOtherA-1445772683-project-member</nova:user>
Nov 28 14:14:34 user nova-compute[75453]:         <nova:project uuid="82ab030af40f43e28b5f1b7ce64c50a8">tempest-ServerActionsTestOtherA-1445772683</nova:project>
Nov 28 14:14:34 user nova-compute[75453]:       </nova:owner>
Nov 28 14:14:34 user nova-compute[75453]:       <nova:ports>
Nov 28 14:14:34 user nova-compute[75453]:         <nova:port uuid="8ffe4343-b471-4fba-bd3b-676b3653941d">
Nov 28 14:14:34 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 14:14:34 user nova-compute[75453]:         </nova:port>
Nov 28 14:14:34 user nova-compute[75453]:       </nova:ports>
Nov 28 14:14:34 user nova-compute[75453]:     </nova:instance>
Nov 28 14:14:34 user nova-compute[75453]:   </metadata>
Nov 28 14:14:34 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:14:34 user nova-compute[75453]:     <system>
Nov 28 14:14:34 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:14:34 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:14:34 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:14:34 user nova-compute[75453]:       <entry name="serial">9f9d0178-d8cd-4d99-930f-7d2f787e899a</entry>
Nov 28 14:14:34 user nova-compute[75453]:       <entry name="uuid">9f9d0178-d8cd-4d99-930f-7d2f787e899a</entry>
Nov 28 14:14:34 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:14:34 user nova-compute[75453]:     </system>
Nov 28 14:14:34 user nova-compute[75453]:   </sysinfo>
Nov 28 14:14:34 user nova-compute[75453]:   <os>
Nov 28 14:14:34 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:14:34 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:14:34 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:14:34 user nova-compute[75453]:   </os>
Nov 28 14:14:34 user nova-compute[75453]:   <features>
Nov 28 14:14:34 user nova-compute[75453]:     <acpi/>
Nov 28 14:14:34 user nova-compute[75453]:     <apic/>
Nov 28 14:14:34 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:14:34 user nova-compute[75453]:   </features>
Nov 28 14:14:34 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:14:34 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:14:34 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:14:34 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:14:34 user nova-compute[75453]:   </clock>
Nov 28 14:14:34 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:14:34 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:14:34 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:14:34 user nova-compute[75453]:   </cpu>
Nov 28 14:14:34 user nova-compute[75453]:   <devices>
Nov 28 14:14:34 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:14:34 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:14:34 user nova-compute[75453]:       <source dev="/dev/sdc"/>
Nov 28 14:14:34 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:14:34 user nova-compute[75453]:       <serial>ffa8b858-5204-4333-a839-2d585c38b878</serial>
Nov 28 14:14:34 user nova-compute[75453]:     </disk>
Nov 28 14:14:34 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:14:34 user nova-compute[75453]:       <mac address="fa:16:3e:c4:0b:d2"/>
Nov 28 14:14:34 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:14:34 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:14:34 user nova-compute[75453]:       <target dev="tap8ffe4343-b4"/>
Nov 28 14:14:34 user nova-compute[75453]:     </interface>
Nov 28 14:14:34 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:14:34 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/9f9d0178-d8cd-4d99-930f-7d2f787e899a/console.log" append="off"/>
Nov 28 14:14:34 user nova-compute[75453]:     </serial>
Nov 28 14:14:34 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:14:34 user nova-compute[75453]:     <video>
Nov 28 14:14:34 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:14:34 user nova-compute[75453]:     </video>
Nov 28 14:14:34 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:14:34 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:14:34 user nova-compute[75453]:     </rng>
Nov 28 14:14:34 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:14:34 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:14:34 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:14:34 user nova-compute[75453]:     </memballoon>
Nov 28 14:14:34 user nova-compute[75453]:   </devices>
Nov 28 14:14:34 user nova-compute[75453]: </domain>
Nov 28 14:14:34 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1596818341',display_name='tempest-ServerActionsTestOtherA-server-1596818341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1596818341',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g==',key_name='tempest-keypair-1318751346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-s73uintr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=9f9d0178-d8cd-4d99-930f-7d2f787e899a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG os_vif [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25b2b597-efdf-5822-8e20-ce42b49f0cd1', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ffe4343-b4, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ffe4343-b4, col_values=(('qos', UUID('413b75c7-231f-4f68-9bff-0b87d8da546e')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ffe4343-b4, col_values=(('external_ids', {'iface-id': '8ffe4343-b471-4fba-bd3b-676b3653941d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:0b:d2', 'vm-uuid': '9f9d0178-d8cd-4d99-930f-7d2f787e899a'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:34 user nova-compute[75453]: INFO os_vif [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4')
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:14:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No VIF found with MAC fa:16:3e:c4:0b:d2, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:14:34 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Snapshot image upload complete
Nov 28 14:14:34 user nova-compute[75453]: INFO nova.compute.manager [None req-477075cc-02e0-48ee-83bb-607876b660ef tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Took 5.58 seconds to snapshot the instance on the hypervisor.
Nov 28 14:14:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] No waiting events found dispatching network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:36 user nova-compute[75453]: WARNING nova.compute.manager [req-42e3aec3-c845-4e7b-81d0-5cefc7b4c56a req-7603f4bb-34e1-4322-83d4-674e465f054a service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received unexpected event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d for instance with vm_state building and task_state spawning.
Nov 28 14:14:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:14:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Instance spawned successfully.
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:14:38 user nova-compute[75453]: INFO nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:14:38 user nova-compute[75453]: INFO nova.compute.manager [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Took 13.36 seconds to build instance.
Nov 28 14:14:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-641d77e1-5313-4482-86ee-9476128475a6 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.784s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:14:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] No waiting events found dispatching network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:14:38 user nova-compute[75453]: WARNING nova.compute.manager [req-7c76e9f3-334b-4554-9849-fe57d0113f91 req-4a25d261-2566-4511-8c9b-da9904367317 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received unexpected event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d for instance with vm_state active and task_state None.
Nov 28 14:14:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:14:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:14:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:15:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:20 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:21 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:15:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:15:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:15:21 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updating instance_info_cache with network_info: [{"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:24 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:15:24 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.063568115234375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:15:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:15:26 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:26 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:15:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:15:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:15:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:15:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:15:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:15:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:15:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:15:36 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:15:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:15:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:15:37 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:15:37 user nova-compute[75453]: INFO nova.compute.claims [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Claim successful on node user
Nov 28 14:15:37 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:15:37 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:15:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:15:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:15:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:15:37 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:15:37 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:15:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:15:37 user nova-compute[75453]: INFO nova.virt.block_device [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Booting with volume-backed-image 0d03e2fc-4d16-4fd7-9616-933da07dcf7b at /dev/vda
Nov 28 14:15:37 user nova-compute[75453]: DEBUG nova.policy [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f88c92554f0f44b0be661aa40aec8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3b398da714d8cb92fad7f64d5c64e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Successfully created port: c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Successfully updated port: c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquired lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-changed-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Refreshing instance network info cache due to event network-changed-c8370c9d-f591-4a61-bce4-077c3a3b7ff6. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] Acquiring lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:15:38 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:15:39 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Updating instance_info_cache with network_info: [{"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:15:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Releasing lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:15:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Instance network_info: |[{"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:15:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] Acquired lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:15:39 user nova-compute[75453]: DEBUG nova.network.neutron [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Refreshing network info cache for port c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:15:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:39 user nova-compute[75453]: DEBUG nova.network.neutron [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Updated VIF entry in instance network info cache for port c8370c9d-f591-4a61-bce4-077c3a3b7ff6. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:15:39 user nova-compute[75453]: DEBUG nova.network.neutron [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Updating instance_info_cache with network_info: [{"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:15:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0d65070-c2d5-460a-b965-9d648d29418e req-065d0805-7b8a-49b7-ada2-5cef275bb3b6 service nova] Releasing lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG os_brick.utils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed2718a-036d-428c-b6c2-041b94be0689]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[739acc4a-6087-4eda-98dc-b9cc8b6cabab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe20284b-7386-456b-a4ee-bcb47f9a3abc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68e51b5-a9ca-4a38-bb89-e98fc41ed6ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:15:43 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:15:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d410a51-f7e5-4b33-9bff-d4ca2a245f7e]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG os_brick.utils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:15:43 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Updating existing volume attachment record: 694b4d50-a7c5-4eb1-bc00-7d2608e6e0d2 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:15:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:15:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:15:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:15:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:15:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:15:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:15:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:15:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:15:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:15:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Creating image(s)
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Ensure instance console log exists: /opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Start _get_guest_xml network_info=[{"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '694b4d50-a7c5-4eb1-bc00-7d2608e6e0d2', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlRoijes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e93e8e5-ec04-43bc-8c31-c03ef461cc62', 'attached_at': '', 'detached_at': '', 'volume_id': '945f888e-cd33-435d-bf1c-285d8da969bd', 'serial': '945f888e-cd33-435d-bf1c-285d8da969bd'}, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:15:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:15:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlRoijes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:15:50 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:15:50 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:15:50 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64dbf2e-dcd1-4187-80cd-ec74544c4546]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:15:50 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79ad12c-261e-4698-84c9-a98768dd47ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd] added
Nov 28 14:15:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f004367-c262-415f-891c-1d2fd75773db]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[99615217-a725-4ac4-922f-1a8006095c56]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlRoijes {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlRoijes" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9bcb17-9c5d-43a2-85c9-390414fa16b5]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MlRoijes'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d8b218-85de-4221-9215-7841a53fca12]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a88d769-a9dd-4b89-ad72-60d116bb99a9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:15:50 user nova-compute[75453]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:15:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:15:50 user nova-compute[75453]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:15:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9448d083-a8f0-4496-b6ee-d8cc2c585e49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd, portal: 172.16.0.220,3260]
Nov 28 14:15:50 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd, portal: 172.16.0.220,3260] successful.
Nov 28 14:15:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd71b0a-415b-44a0-b90d-1e6208d9104b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e35ca1-ed62-484a-b3b5-4d1f3459ecfc]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:15:50 user nova-compute[75453]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:15:50 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:15:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:15:50 user nova-compute[75453]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:15:50 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:15:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6a8a59-e90e-46cf-8772-b94c2c0bf29b]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:15:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlRoijes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26364363934643532', 'path': '/dev/sdd'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364363934643532', 'path': '/dev/sdd'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2115577482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2115577482',id=38,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-e6v4586r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:15:38Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=7e93e8e5-ec04-43bc-8c31-c03ef461cc62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5d:9e,bridge_name='br-int',has_traffic_filtering=True,id=c8370c9d-f591-4a61-bce4-077c3a3b7ff6,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8370c9d-f5') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:15:51 user nova-compute[75453]:   <uuid>7e93e8e5-ec04-43bc-8c31-c03ef461cc62</uuid>
Nov 28 14:15:51 user nova-compute[75453]:   <name>instance-00000026</name>
Nov 28 14:15:51 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:15:51 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:15:51 user nova-compute[75453]:   <metadata>
Nov 28 14:15:51 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:15:51 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:15:51 user nova-compute[75453]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2115577482</nova:name>
Nov 28 14:15:51 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:15:50</nova:creationTime>
Nov 28 14:15:51 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:15:51 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:15:51 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:15:51 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:15:51 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:15:51 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:15:51 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:15:51 user nova-compute[75453]:       <nova:owner>
Nov 28 14:15:51 user nova-compute[75453]:         <nova:user uuid="f88c92554f0f44b0be661aa40aec8670">tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member</nova:user>
Nov 28 14:15:51 user nova-compute[75453]:         <nova:project uuid="3de3b398da714d8cb92fad7f64d5c64e">tempest-ServerBootFromVolumeStableRescueTest-682344680</nova:project>
Nov 28 14:15:51 user nova-compute[75453]:       </nova:owner>
Nov 28 14:15:51 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:15:51 user nova-compute[75453]:       <nova:ports>
Nov 28 14:15:51 user nova-compute[75453]:         <nova:port uuid="c8370c9d-f591-4a61-bce4-077c3a3b7ff6">
Nov 28 14:15:51 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:15:51 user nova-compute[75453]:         </nova:port>
Nov 28 14:15:51 user nova-compute[75453]:       </nova:ports>
Nov 28 14:15:51 user nova-compute[75453]:     </nova:instance>
Nov 28 14:15:51 user nova-compute[75453]:   </metadata>
Nov 28 14:15:51 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:15:51 user nova-compute[75453]:     <system>
Nov 28 14:15:51 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:15:51 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:15:51 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:15:51 user nova-compute[75453]:       <entry name="serial">7e93e8e5-ec04-43bc-8c31-c03ef461cc62</entry>
Nov 28 14:15:51 user nova-compute[75453]:       <entry name="uuid">7e93e8e5-ec04-43bc-8c31-c03ef461cc62</entry>
Nov 28 14:15:51 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:15:51 user nova-compute[75453]:     </system>
Nov 28 14:15:51 user nova-compute[75453]:   </sysinfo>
Nov 28 14:15:51 user nova-compute[75453]:   <os>
Nov 28 14:15:51 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:15:51 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:15:51 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:15:51 user nova-compute[75453]:   </os>
Nov 28 14:15:51 user nova-compute[75453]:   <features>
Nov 28 14:15:51 user nova-compute[75453]:     <acpi/>
Nov 28 14:15:51 user nova-compute[75453]:     <apic/>
Nov 28 14:15:51 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:15:51 user nova-compute[75453]:   </features>
Nov 28 14:15:51 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:15:51 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:15:51 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:15:51 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:15:51 user nova-compute[75453]:   </clock>
Nov 28 14:15:51 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:15:51 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:15:51 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:15:51 user nova-compute[75453]:   </cpu>
Nov 28 14:15:51 user nova-compute[75453]:   <devices>
Nov 28 14:15:51 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:15:51 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:15:51 user nova-compute[75453]:       <source dev="/dev/sdd"/>
Nov 28 14:15:51 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:15:51 user nova-compute[75453]:       <serial>945f888e-cd33-435d-bf1c-285d8da969bd</serial>
Nov 28 14:15:51 user nova-compute[75453]:     </disk>
Nov 28 14:15:51 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:15:51 user nova-compute[75453]:       <mac address="fa:16:3e:c7:5d:9e"/>
Nov 28 14:15:51 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:15:51 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:15:51 user nova-compute[75453]:       <target dev="tapc8370c9d-f5"/>
Nov 28 14:15:51 user nova-compute[75453]:     </interface>
Nov 28 14:15:51 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:15:51 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/console.log" append="off"/>
Nov 28 14:15:51 user nova-compute[75453]:     </serial>
Nov 28 14:15:51 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:15:51 user nova-compute[75453]:     <video>
Nov 28 14:15:51 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:15:51 user nova-compute[75453]:     </video>
Nov 28 14:15:51 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:15:51 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:15:51 user nova-compute[75453]:     </rng>
Nov 28 14:15:51 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:15:51 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:15:51 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:15:51 user nova-compute[75453]:     </memballoon>
Nov 28 14:15:51 user nova-compute[75453]:   </devices>
Nov 28 14:15:51 user nova-compute[75453]: </domain>
Nov 28 14:15:51 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2115577482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2115577482',id=38,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-e6v4586r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:15:38Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=7e93e8e5-ec04-43bc-8c31-c03ef461cc62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5d:9e,bridge_name='br-int',has_traffic_filtering=True,id=c8370c9d-f591-4a61-bce4-077c3a3b7ff6,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8370c9d-f5') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG os_vif [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5d:9e,bridge_name='br-int',has_traffic_filtering=True,id=c8370c9d-f591-4a61-bce4-077c3a3b7ff6,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8370c9d-f5') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '866c0007-1121-5a8b-988e-53929ccec550', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8370c9d-f5, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8370c9d-f5, col_values=(('qos', UUID('1fef3724-dda0-4420-b631-7feac871e835')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8370c9d-f5, col_values=(('external_ids', {'iface-id': 'c8370c9d-f591-4a61-bce4-077c3a3b7ff6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:5d:9e', 'vm-uuid': '7e93e8e5-ec04-43bc-8c31-c03ef461cc62'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:51 user nova-compute[75453]: INFO os_vif [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5d:9e,bridge_name='br-int',has_traffic_filtering=True,id=c8370c9d-f591-4a61-bce4-077c3a3b7ff6,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8370c9d-f5')
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:15:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No VIF found with MAC fa:16:3e:c7:5d:9e, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:15:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:15:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:15:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:15:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:15:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:15:52 user nova-compute[75453]: WARNING nova.compute.manager [req-94819f23-60c1-4f0f-b7a2-cc0c7cb37702 req-24a968b2-c39d-488a-b845-170f31ba0bdb service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state building and task_state spawning.
Nov 28 14:15:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:15:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:15:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Instance spawned successfully.
Nov 28 14:15:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:15:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:15:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:15:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:15:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:15:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:15:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:15:55 user nova-compute[75453]: INFO nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 28 14:15:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:15:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:15:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:15:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:15:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:15:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:15:55 user nova-compute[75453]: WARNING nova.compute.manager [req-00417adc-0bea-4a06-9133-8ba0bad2bffc req-e93d45df-2eb8-4cc3-a5f4-cd9a28927f6d service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state building and task_state spawning.
Nov 28 14:15:55 user nova-compute[75453]: INFO nova.compute.manager [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Took 18.07 seconds to build instance.
Nov 28 14:15:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f58bb70d-abb6-49f3-a355-7e178e34afd9 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.172s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:15:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:15:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:10 user nova-compute[75453]: INFO nova.compute.manager [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Unshelving
Nov 28 14:16:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:10 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'pci_requests' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'numa_topology' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:16:11 user nova-compute[75453]: INFO nova.compute.claims [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Claim successful on node user
Nov 28 14:16:11 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:11 user nova-compute[75453]: INFO nova.network.neutron [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating port 083dcc40-7aec-41be-81b9-aaad0c58aa1f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:16:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquired lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-changed-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Refreshing instance network info cache due to event network-changed-083dcc40-7aec-41be-81b9-aaad0c58aa1f. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] Acquiring lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating instance_info_cache with network_info: [{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Releasing lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:16:12 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Creating image(s)
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'trusted_certs' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] Acquired lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG nova.network.neutron [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Refreshing network info cache for port 083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG nova.objects.base [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<ab749a19-fc12-4a97-9a7d-7a5410b2038d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "30ef75657ba578a2fdd9d77a3e8b3c5665468478" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "30ef75657ba578a2fdd9d77a3e8b3c5665468478" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:13 user nova-compute[75453]: DEBUG nova.virt.images [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] 8c21cadc-efca-4e7d-8f48-252ccd094f62 was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 14:16:13 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:16:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478.part /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:13 user nova-compute[75453]: DEBUG nova.network.neutron [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updated VIF entry in instance network info cache for port 083dcc40-7aec-41be-81b9-aaad0c58aa1f. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:16:13 user nova-compute[75453]: DEBUG nova.network.neutron [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating instance_info_cache with network_info: [{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:16:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1d5cc1cf-0fa3-4dfc-b19c-a1b704a5fe79 req-43712546-4f52-4130-a03e-4163ef85b7f6 service nova] Releasing lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:16:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478.part /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478.converted" returned: 0 in 0.787s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "30ef75657ba578a2fdd9d77a3e8b3c5665468478" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.233s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478 --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "30ef75657ba578a2fdd9d77a3e8b3c5665468478" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "30ef75657ba578a2fdd9d77a3e8b3c5665468478" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478 --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478,backing_fmt=raw /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478,backing_fmt=raw /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk 1073741824" returned: 0 in 0.054s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "30ef75657ba578a2fdd9d77a3e8b3c5665468478" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478 --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478 --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'migration_context' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG nova.objects.base [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<ab749a19-fc12-4a97-9a7d-7a5410b2038d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:16:15 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Rebasing disk image.
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG nova.compute.manager [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received event network-changed-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG nova.compute.manager [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Refreshing instance network info cache due to event network-changed-f0bdc249-748c-4d50-82ce-ad985120d91f. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] Acquiring lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] Acquired lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG nova.network.neutron [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Refreshing network info cache for port f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d -F raw /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG nova.network.neutron [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updated VIF entry in instance network info cache for port f0bdc249-748c-4d50-82ce-ad985120d91f. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG nova.network.neutron [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updating instance_info_cache with network_info: [{"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:16:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-41f98800-b59c-415d-9039-c34fe19ed870 req-d5498eb6-bbc5-4a40-a98c-f31d0574c0a5 service nova] Releasing lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:16:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Stashing vm_state: active {{(pid=75453) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-changed-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG nova.compute.manager [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Refreshing instance network info cache due to event network-changed-8ffe4343-b471-4fba-bd3b-676b3653941d. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] Acquiring lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] Acquired lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG nova.network.neutron [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Refreshing network info cache for port 8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:16:17 user nova-compute[75453]: INFO nova.compute.claims [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Claim successful on node user
Nov 28 14:16:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d -F raw /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk" returned: 0 in 2.473s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Ensure instance console log exists: /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Start _get_guest_xml network_info=[{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='208fa919567b72feda79bfa8e9d68a4d',container_format='bare',created_at=2023-11-28T14:14:18Z,direct_url=<?>,disk_format='qcow2',id=8c21cadc-efca-4e7d-8f48-252ccd094f62,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-305119202-shelved',owner='bb60c747fc434b8a8bb9a0df65970d92',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T14:14:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:16:18 user nova-compute[75453]: INFO nova.compute.resource_tracker [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating resource usage from migration 499d0b2c-7a2a-4928-b780-fe8faad17079
Nov 28 14:16:18 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:16:18 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='208fa919567b72feda79bfa8e9d68a4d',container_format='bare',created_at=2023-11-28T14:14:18Z,direct_url=<?>,disk_format='qcow2',id=8c21cadc-efca-4e7d-8f48-252ccd094f62,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-305119202-shelved',owner='bb60c747fc434b8a8bb9a0df65970d92',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T14:14:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'vcpu_model' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.objects.base [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<ab749a19-fc12-4a97-9a7d-7a5410b2038d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-305119202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-305119202',id=34,image_ref='8c21cadc-efca-4e7d-8f48-252ccd094f62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1146512233',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:12:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-p3df4rdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member',shelved_at='2023-11-28T14:14:22.084391',shelved_host='user',shelved_image_id='8c21cadc-efca-4e7d-8f48-252ccd094f62'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=ab749a19-fc12-4a97-9a7d-7a5410b2038d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.objects.instance [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'pci_devices' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.objects.base [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Object Instance<ab749a19-fc12-4a97-9a7d-7a5410b2038d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:16:18 user nova-compute[75453]:   <uuid>ab749a19-fc12-4a97-9a7d-7a5410b2038d</uuid>
Nov 28 14:16:18 user nova-compute[75453]:   <name>instance-00000022</name>
Nov 28 14:16:18 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:16:18 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:16:18 user nova-compute[75453]:   <metadata>
Nov 28 14:16:18 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:16:18 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:16:18 user nova-compute[75453]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-305119202</nova:name>
Nov 28 14:16:18 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:16:18</nova:creationTime>
Nov 28 14:16:18 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:16:18 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:16:18 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:16:18 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:16:18 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:16:18 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:16:18 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:16:18 user nova-compute[75453]:       <nova:owner>
Nov 28 14:16:18 user nova-compute[75453]:         <nova:user uuid="e8074110936b461690a6518ddee180ac">tempest-AttachVolumeShelveTestJSON-1619345525-project-member</nova:user>
Nov 28 14:16:18 user nova-compute[75453]:         <nova:project uuid="bb60c747fc434b8a8bb9a0df65970d92">tempest-AttachVolumeShelveTestJSON-1619345525</nova:project>
Nov 28 14:16:18 user nova-compute[75453]:       </nova:owner>
Nov 28 14:16:18 user nova-compute[75453]:       <nova:root type="image" uuid="8c21cadc-efca-4e7d-8f48-252ccd094f62"/>
Nov 28 14:16:18 user nova-compute[75453]:       <nova:ports>
Nov 28 14:16:18 user nova-compute[75453]:         <nova:port uuid="083dcc40-7aec-41be-81b9-aaad0c58aa1f">
Nov 28 14:16:18 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 14:16:18 user nova-compute[75453]:         </nova:port>
Nov 28 14:16:18 user nova-compute[75453]:       </nova:ports>
Nov 28 14:16:18 user nova-compute[75453]:     </nova:instance>
Nov 28 14:16:18 user nova-compute[75453]:   </metadata>
Nov 28 14:16:18 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:16:18 user nova-compute[75453]:     <system>
Nov 28 14:16:18 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:16:18 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:16:18 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:16:18 user nova-compute[75453]:       <entry name="serial">ab749a19-fc12-4a97-9a7d-7a5410b2038d</entry>
Nov 28 14:16:18 user nova-compute[75453]:       <entry name="uuid">ab749a19-fc12-4a97-9a7d-7a5410b2038d</entry>
Nov 28 14:16:18 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:16:18 user nova-compute[75453]:     </system>
Nov 28 14:16:18 user nova-compute[75453]:   </sysinfo>
Nov 28 14:16:18 user nova-compute[75453]:   <os>
Nov 28 14:16:18 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:16:18 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:16:18 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:16:18 user nova-compute[75453]:   </os>
Nov 28 14:16:18 user nova-compute[75453]:   <features>
Nov 28 14:16:18 user nova-compute[75453]:     <acpi/>
Nov 28 14:16:18 user nova-compute[75453]:     <apic/>
Nov 28 14:16:18 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:16:18 user nova-compute[75453]:   </features>
Nov 28 14:16:18 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:16:18 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:16:18 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:16:18 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:16:18 user nova-compute[75453]:   </clock>
Nov 28 14:16:18 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:16:18 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:16:18 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:16:18 user nova-compute[75453]:   </cpu>
Nov 28 14:16:18 user nova-compute[75453]:   <devices>
Nov 28 14:16:18 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:16:18 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:16:18 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk"/>
Nov 28 14:16:18 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:16:18 user nova-compute[75453]:     </disk>
Nov 28 14:16:18 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:16:18 user nova-compute[75453]:       <mac address="fa:16:3e:e2:7f:e6"/>
Nov 28 14:16:18 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:16:18 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:16:18 user nova-compute[75453]:       <target dev="tap083dcc40-7a"/>
Nov 28 14:16:18 user nova-compute[75453]:     </interface>
Nov 28 14:16:18 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:16:18 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/console.log" append="off"/>
Nov 28 14:16:18 user nova-compute[75453]:     </serial>
Nov 28 14:16:18 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:16:18 user nova-compute[75453]:     <video>
Nov 28 14:16:18 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:16:18 user nova-compute[75453]:     </video>
Nov 28 14:16:18 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:16:18 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:16:18 user nova-compute[75453]:     </rng>
Nov 28 14:16:18 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:16:18 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:16:18 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:16:18 user nova-compute[75453]:     </memballoon>
Nov 28 14:16:18 user nova-compute[75453]:   </devices>
Nov 28 14:16:18 user nova-compute[75453]: </domain>
Nov 28 14:16:18 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-305119202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-305119202',id=34,image_ref='8c21cadc-efca-4e7d-8f48-252ccd094f62',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1146512233',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:12:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-p3df4rdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member',shelved_at='2023-11-28T14:14:22.084391',shelved_host='user',shelved_image_id='8c21cadc-efca-4e7d-8f48-252ccd094f62'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=ab749a19-fc12-4a97-9a7d-7a5410b2038d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG os_vif [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43d84ae8-32c0-5815-acbc-71fae9e45ee7', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap083dcc40-7a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap083dcc40-7a, col_values=(('qos', UUID('41a5d5e3-b4e4-4dff-9312-71f3c1fcfef6')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap083dcc40-7a, col_values=(('external_ids', {'iface-id': '083dcc40-7aec-41be-81b9-aaad0c58aa1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:7f:e6', 'vm-uuid': 'ab749a19-fc12-4a97-9a7d-7a5410b2038d'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:18 user nova-compute[75453]: INFO os_vif [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a')
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] No VIF found with MAC fa:16:3e:e2:7f:e6, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.network.neutron [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updated VIF entry in instance network info cache for port 8ffe4343-b471-4fba-bd3b-676b3653941d. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.network.neutron [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating instance_info_cache with network_info: [{"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2b5bf2ce-668d-4181-aa44-4eb91f3d8be9 req-5eeb416b-30c3-4e4d-8ce8-b17cbc568732 service nova] Releasing lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.565s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:18 user nova-compute[75453]: INFO nova.compute.manager [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Migrating
Nov 28 14:16:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquired lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating instance_info_cache with network_info: [{"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Releasing lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:16:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Starting migrate_disk_and_power_off {{(pid=75453) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-unplugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] No waiting events found dispatching network-vif-unplugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:16:19 user nova-compute[75453]: WARNING nova.compute.manager [req-1859edd2-4756-419a-9a58-c8a8bc23ac67 req-865a4768-428d-4f3a-8633-ea5b5fbaefc9 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received unexpected event network-vif-unplugged-8ffe4343-b471-4fba-bd3b-676b3653941d for instance with vm_state active and task_state resize_migrating.
Nov 28 14:16:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:16:19 user nova-compute[75453]: WARNING nova.compute.manager [req-697f8e72-dc42-4dc8-8eb3-b897f220a462 req-2e5747e4-2727-4fe5-a20d-67ddbd19ae90 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 14:16:20 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Instance destroyed successfully.
Nov 28 14:16:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1596818341',display_name='tempest-ServerActionsTestOtherA-server-1596818341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1596818341',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g==',key_name='tempest-keypair-1318751346',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:14:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-s73uintr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:16:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=9f9d0178-d8cd-4d99-930f-7d2f787e899a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1861306989-network", "vif_mac": "fa:16:3e:c4:0b:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1861306989-network", "vif_mac": "fa:16:3e:c4:0b:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_vif [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ffe4343-b4, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=413b75c7-231f-4f68-9bff-0b87d8da546e) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:16:20 user nova-compute[75453]: INFO os_vif [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4')
Nov 28 14:16:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGMlvmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:16:20 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3c7dde-c8d9-4698-be28-bb872618e960]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:16:20 user nova-compute[75453]: No targets found.
Nov 28 14:16:20 user nova-compute[75453]: iSNS:
Nov 28 14:16:20 user nova-compute[75453]: No targets found.
Nov 28 14:16:20 user nova-compute[75453]: STATIC:
Nov 28 14:16:20 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878
Nov 28 14:16:20 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:16:20 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:16:20 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd
Nov 28 14:16:20 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:16:20 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:16:20 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:16:20 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:16:20 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:16:20 user nova-compute[75453]: FIRMWARE:
Nov 28 14:16:20 user nova-compute[75453]: No targets found.
Nov 28 14:16:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:16:20 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:16:20 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe43889-276d-47e5-8829-0f0844e914e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6678d8-8a19-4412-a470-52a5f2319ce8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:16:20 user nova-compute[75453]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:16:20 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:16:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:16:20 user nova-compute[75453]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:16:20 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:16:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c54e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5b23ad-e31e-4b60-b5fe-eff1809a8d8d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fee666-ff02-45eb-beb0-c17d13b7adc3]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a64a08-481d-475e-9b83-79090fcad99b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43040ff-d8d5-41d3-9b23-ffaffa4c408c]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0cba84-27bb-4aa4-85ba-a39e845c6df1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f4196-a1bb-4f51-92b2-734ab9ebe8ae]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260]
Nov 28 14:16:20 user nova-compute[75453]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260] successful.
Nov 28 14:16:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16a053a-0a53-400b-ae5f-54f11df74bf9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== disconnect_volume: return (347ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:16:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] No waiting events found dispatching network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:16:21 user nova-compute[75453]: WARNING nova.compute.manager [req-57f7b513-d69f-40d2-8ba0-7a341436c14c req-5685c433-351f-43b2-88b3-4045cefb58c2 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received unexpected event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d for instance with vm_state active and task_state resize_migrating.
Nov 28 14:16:21 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Port 8ffe4343-b471-4fba-bd3b-676b3653941d binding to destination host user is already ACTIVE {{(pid=75453) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquired lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:16:21 user nova-compute[75453]: WARNING nova.compute.manager [req-1e128d85-cc21-4bcd-a4b2-1137fb9e939f req-c5fcd797-5af9-4467-9d41-dc9e4a81dc51 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 14:16:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:16:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance spawned successfully.
Nov 28 14:16:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating instance_info_cache with network_info: [{"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Releasing lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG os_brick.utils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d425487-422c-40e3-9cf8-5b00e3366def]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e706239-e122-4905-b315-cbb4bb5a1280]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274729e-6514-4506-b435-ff563b8b4b0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7670a0-46cd-449c-9e96-04dc27bd3559]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:16:22 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6dc6e7-89ab-42e0-acc2-bbb916d69f96]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG os_brick.utils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-1be9973c-93e2-4217-a1f1-dbeaa9017491 tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.558s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updating instance_info_cache with network_info: [{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:16:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:25 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:16:25 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.027950286865234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Applying migration context for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a as it has an incoming, in-progress migration 499d0b2c-7a2a-4928-b780-fe8faad17079. Migration status is post-migrating {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 14:16:25 user nova-compute[75453]: INFO nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating resource usage from migration 499d0b2c-7a2a-4928-b780-fe8faad17079
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance ab749a19-fc12-4a97-9a7d-7a5410b2038d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Migration 499d0b2c-7a2a-4928-b780-fe8faad17079 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:16:25 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:26 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:16:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:16:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Starting finish_migration {{(pid=75453) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Instance directory exists: not creating {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 14:16:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Creating image(s)
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Ensure instance console log exists: /opt/stack/data/nova/instances/9f9d0178-d8cd-4d99-930f-7d2f787e899a/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Start _get_guest_xml network_info=[{"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1861306989-network", "vif_mac": "fa:16:3e:c4:0b:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '650e4556-47b4-44c6-a00a-14dd0830fe60', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGMlvmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9f9d0178-d8cd-4d99-930f-7d2f787e899a', 'attached_at': '2023-11-28T14:16:29.000000', 'detached_at': '', 'volume_id': 'ffa8b858-5204-4333-a839-2d585c38b878', 'serial': 'ffa8b858-5204-4333-a839-2d585c38b878'}, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:16:29 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:16:29 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGMlvmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:16:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:16:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:16:29 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f50382-92c2-4fc1-9e67-322b16ada5ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:16:29 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cea873a-81ed-42d2-b72f-02bef3d42db6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878] added
Nov 28 14:16:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7099c5d9-5809-4b66-bc47-62af0b137b64]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5b4082-f253-4c54-9611-275191ef29c4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUGMlvmr {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUGMlvmr" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a70951-aa97-453d-abee-ca2c364bdfa8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUGMlvmr'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918a6f3-56bf-477c-ad1c-f30270783a6e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2165c6-1a00-4197-af10-5e58327247a1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:16:29 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:16:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:16:29 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:16:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b8ee19-5ee8-4b49-89a5-e3566bc0614a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260]
Nov 28 14:16:29 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260] successful.
Nov 28 14:16:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b358ffc-3d9c-40bb-9c55-661a92dc6a95]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a73043-77ca-45f6-854a-188cd5b8b4a7]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:16:29 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:16:29 user nova-compute[75453]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:16:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:16:29 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:16:29 user nova-compute[75453]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:16:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35bfa90-4b7a-4b9d-865c-e8a023310fa4]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:16:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGMlvmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:16:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:16:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23935616534343031', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:16:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935616534343031', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:16:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1596818341',display_name='tempest-ServerActionsTestOtherA-server-1596818341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1596818341',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g==',key_name='tempest-keypair-1318751346',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:14:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-s73uintr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=9f9d0178-d8cd-4d99-930f-7d2f787e899a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1861306989-network", "vif_mac": "fa:16:3e:c4:0b:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:16:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1861306989-network", "vif_mac": "fa:16:3e:c4:0b:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:16:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:16:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:16:30 user nova-compute[75453]:   <uuid>9f9d0178-d8cd-4d99-930f-7d2f787e899a</uuid>
Nov 28 14:16:30 user nova-compute[75453]:   <name>instance-00000025</name>
Nov 28 14:16:30 user nova-compute[75453]:   <memory>2097152</memory>
Nov 28 14:16:30 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:16:30 user nova-compute[75453]:   <metadata>
Nov 28 14:16:30 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:16:30 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:16:30 user nova-compute[75453]:       <nova:name>tempest-ServerActionsTestOtherA-server-1596818341</nova:name>
Nov 28 14:16:30 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:16:29</nova:creationTime>
Nov 28 14:16:30 user nova-compute[75453]:       <nova:flavor name="m1.small">
Nov 28 14:16:30 user nova-compute[75453]:         <nova:memory>2048</nova:memory>
Nov 28 14:16:30 user nova-compute[75453]:         <nova:disk>20</nova:disk>
Nov 28 14:16:30 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:16:30 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:16:30 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:16:30 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:16:30 user nova-compute[75453]:       <nova:owner>
Nov 28 14:16:30 user nova-compute[75453]:         <nova:user uuid="9f84ee8a311d4619b7d51c2066d4775f">tempest-ServerActionsTestOtherA-1445772683-project-member</nova:user>
Nov 28 14:16:30 user nova-compute[75453]:         <nova:project uuid="82ab030af40f43e28b5f1b7ce64c50a8">tempest-ServerActionsTestOtherA-1445772683</nova:project>
Nov 28 14:16:30 user nova-compute[75453]:       </nova:owner>
Nov 28 14:16:30 user nova-compute[75453]:       <nova:ports>
Nov 28 14:16:30 user nova-compute[75453]:         <nova:port uuid="8ffe4343-b471-4fba-bd3b-676b3653941d">
Nov 28 14:16:30 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 14:16:30 user nova-compute[75453]:         </nova:port>
Nov 28 14:16:30 user nova-compute[75453]:       </nova:ports>
Nov 28 14:16:30 user nova-compute[75453]:     </nova:instance>
Nov 28 14:16:30 user nova-compute[75453]:   </metadata>
Nov 28 14:16:30 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:16:30 user nova-compute[75453]:     <system>
Nov 28 14:16:30 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:16:30 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:16:30 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:16:30 user nova-compute[75453]:       <entry name="serial">9f9d0178-d8cd-4d99-930f-7d2f787e899a</entry>
Nov 28 14:16:30 user nova-compute[75453]:       <entry name="uuid">9f9d0178-d8cd-4d99-930f-7d2f787e899a</entry>
Nov 28 14:16:30 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:16:30 user nova-compute[75453]:     </system>
Nov 28 14:16:30 user nova-compute[75453]:   </sysinfo>
Nov 28 14:16:30 user nova-compute[75453]:   <os>
Nov 28 14:16:30 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:16:30 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:16:30 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:16:30 user nova-compute[75453]:   </os>
Nov 28 14:16:30 user nova-compute[75453]:   <features>
Nov 28 14:16:30 user nova-compute[75453]:     <acpi/>
Nov 28 14:16:30 user nova-compute[75453]:     <apic/>
Nov 28 14:16:30 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:16:30 user nova-compute[75453]:   </features>
Nov 28 14:16:30 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:16:30 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:16:30 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:16:30 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:16:30 user nova-compute[75453]:   </clock>
Nov 28 14:16:30 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:16:30 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:16:30 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:16:30 user nova-compute[75453]:   </cpu>
Nov 28 14:16:30 user nova-compute[75453]:   <devices>
Nov 28 14:16:30 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:16:30 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:16:30 user nova-compute[75453]:       <source dev="/dev/sdc"/>
Nov 28 14:16:30 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:16:30 user nova-compute[75453]:       <serial>ffa8b858-5204-4333-a839-2d585c38b878</serial>
Nov 28 14:16:30 user nova-compute[75453]:     </disk>
Nov 28 14:16:30 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:16:30 user nova-compute[75453]:       <mac address="fa:16:3e:c4:0b:d2"/>
Nov 28 14:16:30 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:16:30 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:16:30 user nova-compute[75453]:       <target dev="tap8ffe4343-b4"/>
Nov 28 14:16:30 user nova-compute[75453]:     </interface>
Nov 28 14:16:30 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:16:30 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/9f9d0178-d8cd-4d99-930f-7d2f787e899a/console.log" append="off"/>
Nov 28 14:16:30 user nova-compute[75453]:     </serial>
Nov 28 14:16:30 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:16:30 user nova-compute[75453]:     <video>
Nov 28 14:16:30 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:16:30 user nova-compute[75453]:     </video>
Nov 28 14:16:30 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:16:30 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:16:30 user nova-compute[75453]:     </rng>
Nov 28 14:16:30 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:16:30 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:16:30 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:16:30 user nova-compute[75453]:     </memballoon>
Nov 28 14:16:30 user nova-compute[75453]:   </devices>
Nov 28 14:16:30 user nova-compute[75453]: </domain>
Nov 28 14:16:30 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1596818341',display_name='tempest-ServerActionsTestOtherA-server-1596818341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1596818341',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g==',key_name='tempest-keypair-1318751346',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:14:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-s73uintr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=9f9d0178-d8cd-4d99-930f-7d2f787e899a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1861306989-network", "vif_mac": "fa:16:3e:c4:0b:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1861306989-network", "vif_mac": "fa:16:3e:c4:0b:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG os_vif [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25b2b597-efdf-5822-8e20-ce42b49f0cd1', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ffe4343-b4, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ffe4343-b4, col_values=(('qos', UUID('2102c6a3-593b-471d-accd-912ebd91ba37')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ffe4343-b4, col_values=(('external_ids', {'iface-id': '8ffe4343-b471-4fba-bd3b-676b3653941d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:0b:d2', 'vm-uuid': '9f9d0178-d8cd-4d99-930f-7d2f787e899a'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:31 user nova-compute[75453]: INFO os_vif [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4')
Nov 28 14:16:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:16:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] No VIF found with MAC fa:16:3e:c4:0b:d2, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:16:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:16:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] No waiting events found dispatching network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:16:32 user nova-compute[75453]: WARNING nova.compute.manager [req-a0bf4e91-22ed-454d-b69f-74d472b4732c req-77951d59-5dc1-44d2-b20d-8f53e39d57f1 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received unexpected event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d for instance with vm_state active and task_state resize_finish.
Nov 28 14:16:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:16:34 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Instance running successfully.
Nov 28 14:16:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Failed to set time: agent not configured {{(pid=75453) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 14:16:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9e2637f5-88c0-42cb-89b1-be7bd3f26d1a tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] finish_migration finished successfully. {{(pid=75453) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 14:16:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:16:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:16:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:16:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:16:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] No waiting events found dispatching network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:16:34 user nova-compute[75453]: WARNING nova.compute.manager [req-9f992904-2d6e-45b3-90b3-7a2a94edadc9 req-df319113-852c-42c3-ad01-b37597176768 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received unexpected event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d for instance with vm_state active and task_state resize_finish.
Nov 28 14:16:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:16:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:17:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:17:20 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:20 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:21 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:17:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:17:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:17:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:17:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:17:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating instance_info_cache with network_info: [{"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-ab749a19-fc12-4a97-9a7d-7a5410b2038d" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:25 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:17:25 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8368MB free_disk=25.02631378173828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Applying migration context for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a as it has an incoming, in-progress migration 499d0b2c-7a2a-4928-b780-fe8faad17079. Migration status is finished {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 14:17:25 user nova-compute[75453]: INFO nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating resource usage from migration 499d0b2c-7a2a-4928-b780-fe8faad17079
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance ab749a19-fc12-4a97-9a7d-7a5410b2038d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Migration 499d0b2c-7a2a-4928-b780-fe8faad17079 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:17:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:17:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:17:27 user nova-compute[75453]: INFO nova.compute.manager [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Rescuing
Nov 28 14:17:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:17:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquired lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:17:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Updating instance_info_cache with network_info: [{"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Releasing lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-unplugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-unplugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:17:28 user nova-compute[75453]: WARNING nova.compute.manager [req-6c69fde6-95ca-4030-a285-c7095d19059b req-63ac2c9a-0b6e-4cc3-a8a4-cfb788bd1bb2 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-unplugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state active and task_state rescuing.
Nov 28 14:17:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Instance destroyed successfully.
Nov 28 14:17:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Attempting a stable device rescue
Nov 28 14:17:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75453) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 14:17:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Instance directory exists: not creating {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 14:17:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Creating image(s)
Nov 28 14:17:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:17:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "/opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:17:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "/opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:17:29 user nova-compute[75453]: DEBUG nova.objects.instance [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:17:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "637199ebd2cd2b247332ff7f0519c8ff3ae559ed" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:17:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "637199ebd2cd2b247332ff7f0519c8ff3ae559ed" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG nova.virt.images [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] 26883cef-55e4-4f8a-92e7-deea8797fb37 was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed.part /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:17:30 user nova-compute[75453]: WARNING nova.compute.manager [req-aec3ffde-580e-486a-b741-221a236e739c req-ed4556e3-5137-4122-8391-453945458b18 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state active and task_state rescuing.
Nov 28 14:17:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed.part /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed.converted" returned: 0 in 0.514s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "637199ebd2cd2b247332ff7f0519c8ff3ae559ed" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.846s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "637199ebd2cd2b247332ff7f0519c8ff3ae559ed" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "637199ebd2cd2b247332ff7f0519c8ff3ae559ed" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed,backing_fmt=raw /opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.rescue {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed,backing_fmt=raw /opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.rescue" returned: 0 in 0.054s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "637199ebd2cd2b247332ff7f0519c8ff3ae559ed" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.instance [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'migration_context' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<7e93e8e5-ec04-43bc-8c31-c03ef461cc62> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Start _get_guest_xml network_info=[{"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "vif_mac": "fa:16:3e:c7:5d:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '26883cef-55e4-4f8a-92e7-deea8797fb37', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '694b4d50-a7c5-4eb1-bc00-7d2608e6e0d2', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlRoijes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '7e93e8e5-ec04-43bc-8c31-c03ef461cc62', 'attached_at': '', 'detached_at': '', 'volume_id': '945f888e-cd33-435d-bf1c-285d8da969bd', 'serial': '945f888e-cd33-435d-bf1c-285d8da969bd'}, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.instance [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'resources' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<7e93e8e5-ec04-43bc-8c31-c03ef461cc62> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.instance [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<7e93e8e5-ec04-43bc-8c31-c03ef461cc62> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:17:31 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:17:31 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.instance [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<7e93e8e5-ec04-43bc-8c31-c03ef461cc62> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlRoijes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:17:31 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:17:31 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:17:31 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1069436-68e4-4e81-905e-35b8e6d4c773]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MlRoijes\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 14:17:31 user nova-compute[75453]: node.name = iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd
Nov 28 14:17:31 user nova-compute[75453]: node.tpgt = -1
Nov 28 14:17:31 user nova-compute[75453]: node.startup = automatic
Nov 28 14:17:31 user nova-compute[75453]: node.leading_login = No
Nov 28 14:17:31 user nova-compute[75453]: iface.iscsi_ifacename = default
Nov 28 14:17:31 user nova-compute[75453]: iface.net_ifacename = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.ipaddress = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.prefix_len = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.hwaddress = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.transport_name = tcp
Nov 28 14:17:31 user nova-compute[75453]: iface.initiatorname = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.state = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.vlan_id = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.vlan_priority = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.vlan_state = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.iface_num = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.mtu = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.port = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.bootproto = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.subnet_mask = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.gateway = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.dhcp_alt_client_id = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.dhcp_dns = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.dhcp_learn_iqn = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.dhcp_vendor_id_state = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.dhcp_vendor_id = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.dhcp_slp_da = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.fragmentation = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.gratuitous_arp = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.incoming_forwarding = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.tos_state = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.tos = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.ttl = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.delayed_ack = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.tcp_nagle = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.tcp_wsf_state = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.tcp_wsf = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.tcp_timer_scale = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.tcp_timestamp = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.redirect = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.def_task_mgmt_timeout = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.header_digest = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.data_digest = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.immediate_data = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.initial_r2t = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.data_seq_inorder = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.data_pdu_inorder = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.erl = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.max_receive_data_len = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.first_burst_len = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.max_outstanding_r2t = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.max_burst_len = 0
Nov 28 14:17:31 user nova-compute[75453]: iface.chap_auth = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.bidi_chap = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.strict_login_compliance = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.discovery_auth = <empty>
Nov 28 14:17:31 user nova-compute[75453]: iface.discovery_logout = <empty>
Nov 28 14:17:31 user nova-compute[75453]: node.discovery_address = <empty>
Nov 28 14:17:31 user nova-compute[75453]: node.discovery_port = 0
Nov 28 14:17:31 user nova-compute[75453]: node.discovery_type = static
Nov 28 14:17:31 user nova-compute[75453]: node.session.initial_cmdsn = 0
Nov 28 14:17:31 user nova-compute[75453]: node.session.initial_login_retry_max = 8
Nov 28 14:17:31 user nova-compute[75453]: node.session.xmit_thread_priority = -20
Nov 28 14:17:31 user nova-compute[75453]: node.session.cmds_max = 128
Nov 28 14:17:31 user nova-compute[75453]: node.session.queue_depth = 32
Nov 28 14:17:31 user nova-compute[75453]: node.session.nr_sessions = 1
Nov 28 14:17:31 user nova-compute[75453]: node.session.auth.authmethod = CHAP
Nov 28 14:17:31 user nova-compute[75453]: node.session.auth.username = MlRoijes
Nov 28 14:17:31 user nova-compute[75453]: node.session.auth.password = ***
Nov 28 14:17:31 user nova-compute[75453]: node.session.auth.username_in = <empty>
Nov 28 14:17:31 user nova-compute[75453]: node.session.auth.password_in = <empty>
Nov 28 14:17:31 user nova-compute[75453]: node.session.auth.chap_algs = MD5
Nov 28 14:17:31 user nova-compute[75453]: node.session.timeo.replacement_timeout = 120
Nov 28 14:17:31 user nova-compute[75453]: node.session.err_timeo.abort_timeout = 15
Nov 28 14:17:31 user nova-compute[75453]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 14:17:31 user nova-compute[75453]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 14:17:31 user nova-compute[75453]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.FastAbort = Yes
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.InitialR2T = No
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.ImmediateData = Yes
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.MaxConnections = 1
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 14:17:31 user nova-compute[75453]: node.session.iscsi.ERL = 0
Nov 28 14:17:31 user nova-compute[75453]: node.session.scan = manual
Nov 28 14:17:31 user nova-compute[75453]: node.session.reopen_max = 0
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].address = 172.16.0.220
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].port = 3260
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].startup = manual
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].tcp.window_size = 524288
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].tcp.type_of_service = 0
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].timeo.logout_timeout = 15
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].timeo.login_timeout = 15
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].timeo.auth_timeout = 45
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].iscsi.DataDigest = None
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].iscsi.IFMarker = No
Nov 28 14:17:31 user nova-compute[75453]: node.conn[0].iscsi.OFMarker = No
Nov 28 14:17:31 user nova-compute[75453]: # END RECORD
Nov 28 14:17:31 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb766c6-67bc-4281-aee9-87317a1302d3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefec6a8-5793-4907-b423-b7efb9360e08]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlRoijes {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlRoijes" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1bc884-b1b7-4ef2-bbfc-ddd47bdf5cb7]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MlRoijes'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b7dd59-6cc5-4fd3-a99c-99d42d27bfe1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2879d102-8362-490f-9187-4c13b39a7400]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:17:31 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:17:31 user nova-compute[75453]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:17:31 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:17:31 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:17:31 user nova-compute[75453]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:17:31 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] HCTL ('35', '0', '0', 0) found on session 45 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[63876b4a-be0c-44f4-ae7b-d7c8df9b7343]: (4, ('0 0 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Searching for a device in session 45 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlRoijes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.185s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] <== connect_volume: return (187ms) {'type': 'block', 'scsi_wwn': '26364363934643532', 'path': '/dev/sdd'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364363934643532', 'path': '/dev/sdd'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2115577482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2115577482',id=38,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:15:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-e6v4586r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:15:55Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=7e93e8e5-ec04-43bc-8c31-c03ef461cc62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "vif_mac": "fa:16:3e:c7:5d:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "vif_mac": "fa:16:3e:c7:5d:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5d:9e,bridge_name='br-int',has_traffic_filtering=True,id=c8370c9d-f591-4a61-bce4-077c3a3b7ff6,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8370c9d-f5') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.instance [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.objects.base [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Object Instance<7e93e8e5-ec04-43bc-8c31-c03ef461cc62> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:17:31 user nova-compute[75453]:   <uuid>7e93e8e5-ec04-43bc-8c31-c03ef461cc62</uuid>
Nov 28 14:17:31 user nova-compute[75453]:   <name>instance-00000026</name>
Nov 28 14:17:31 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:17:31 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:17:31 user nova-compute[75453]:   <metadata>
Nov 28 14:17:31 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:17:31 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:17:31 user nova-compute[75453]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2115577482</nova:name>
Nov 28 14:17:31 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:17:31</nova:creationTime>
Nov 28 14:17:31 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:17:31 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:17:31 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:17:31 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:17:31 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:17:31 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:17:31 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:17:31 user nova-compute[75453]:       <nova:owner>
Nov 28 14:17:31 user nova-compute[75453]:         <nova:user uuid="f88c92554f0f44b0be661aa40aec8670">tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member</nova:user>
Nov 28 14:17:31 user nova-compute[75453]:         <nova:project uuid="3de3b398da714d8cb92fad7f64d5c64e">tempest-ServerBootFromVolumeStableRescueTest-682344680</nova:project>
Nov 28 14:17:31 user nova-compute[75453]:       </nova:owner>
Nov 28 14:17:31 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:17:31 user nova-compute[75453]:       <nova:ports>
Nov 28 14:17:31 user nova-compute[75453]:         <nova:port uuid="c8370c9d-f591-4a61-bce4-077c3a3b7ff6">
Nov 28 14:17:31 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:17:31 user nova-compute[75453]:         </nova:port>
Nov 28 14:17:31 user nova-compute[75453]:       </nova:ports>
Nov 28 14:17:31 user nova-compute[75453]:     </nova:instance>
Nov 28 14:17:31 user nova-compute[75453]:   </metadata>
Nov 28 14:17:31 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:17:31 user nova-compute[75453]:     <system>
Nov 28 14:17:31 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:17:31 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:17:31 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:17:31 user nova-compute[75453]:       <entry name="serial">7e93e8e5-ec04-43bc-8c31-c03ef461cc62</entry>
Nov 28 14:17:31 user nova-compute[75453]:       <entry name="uuid">7e93e8e5-ec04-43bc-8c31-c03ef461cc62</entry>
Nov 28 14:17:31 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:17:31 user nova-compute[75453]:     </system>
Nov 28 14:17:31 user nova-compute[75453]:   </sysinfo>
Nov 28 14:17:31 user nova-compute[75453]:   <os>
Nov 28 14:17:31 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:17:31 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:17:31 user nova-compute[75453]:   </os>
Nov 28 14:17:31 user nova-compute[75453]:   <features>
Nov 28 14:17:31 user nova-compute[75453]:     <acpi/>
Nov 28 14:17:31 user nova-compute[75453]:     <apic/>
Nov 28 14:17:31 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:17:31 user nova-compute[75453]:   </features>
Nov 28 14:17:31 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:17:31 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:17:31 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:17:31 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:17:31 user nova-compute[75453]:   </clock>
Nov 28 14:17:31 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:17:31 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:17:31 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:17:31 user nova-compute[75453]:   </cpu>
Nov 28 14:17:31 user nova-compute[75453]:   <devices>
Nov 28 14:17:31 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:17:31 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:17:31 user nova-compute[75453]:       <source dev="/dev/sdd"/>
Nov 28 14:17:31 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:17:31 user nova-compute[75453]:       <serial>945f888e-cd33-435d-bf1c-285d8da969bd</serial>
Nov 28 14:17:31 user nova-compute[75453]:     </disk>
Nov 28 14:17:31 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:17:31 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:17:31 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.rescue"/>
Nov 28 14:17:31 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 14:17:31 user nova-compute[75453]:       <boot order="1"/>
Nov 28 14:17:31 user nova-compute[75453]:     </disk>
Nov 28 14:17:31 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:17:31 user nova-compute[75453]:       <mac address="fa:16:3e:c7:5d:9e"/>
Nov 28 14:17:31 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:17:31 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:17:31 user nova-compute[75453]:       <target dev="tapc8370c9d-f5"/>
Nov 28 14:17:31 user nova-compute[75453]:     </interface>
Nov 28 14:17:31 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:17:31 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/console.log" append="off"/>
Nov 28 14:17:31 user nova-compute[75453]:     </serial>
Nov 28 14:17:31 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:17:31 user nova-compute[75453]:     <video>
Nov 28 14:17:31 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:17:31 user nova-compute[75453]:     </video>
Nov 28 14:17:31 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:17:31 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:17:31 user nova-compute[75453]:     </rng>
Nov 28 14:17:31 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:17:31 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:17:31 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:17:31 user nova-compute[75453]:     </memballoon>
Nov 28 14:17:31 user nova-compute[75453]:   </devices>
Nov 28 14:17:31 user nova-compute[75453]: </domain>
Nov 28 14:17:31 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:17:31 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Instance destroyed successfully.
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:17:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] No VIF found with MAC fa:16:3e:c7:5d:9e, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:17:33 user nova-compute[75453]: WARNING nova.compute.manager [req-13d25e17-f6f9-407b-9e56-c0b6c439c48d req-fa6105af-9997-45c5-a109-aacd7fc67767 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state active and task_state rescuing.
Nov 28 14:17:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:17:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:17:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:17:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:17:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:17:35 user nova-compute[75453]: DEBUG nova.compute.manager [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:17:35 user nova-compute[75453]: WARNING nova.compute.manager [req-4d768951-7535-45c5-83c5-0f7c1290476a req-213fda72-1a35-47f4-ab4b-4b2d97b8341b service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state active and task_state rescuing.
Nov 28 14:17:35 user nova-compute[75453]: DEBUG nova.compute.manager [None req-aa6d4044-71a1-4a42-98e5-5a25ea8f38f1 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:17:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:17:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:17:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:18:01 user nova-compute[75453]: INFO nova.compute.manager [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Terminating instance
Nov 28 14:18:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-unplugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-unplugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-32d06c12-b225-430e-98ed-47953232bd7f req-58f5a65e-c14d-43c0-a7ce-792f5e7d63f6 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-unplugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:18:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Instance destroyed successfully.
Nov 28 14:18:01 user nova-compute[75453]: DEBUG nova.objects.instance [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lazy-loading 'resources' on Instance uuid ab749a19-fc12-4a97-9a7d-7a5410b2038d {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T14:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-305119202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-305119202',id=34,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASV6MnUadFAc7iZ7kDsGBeSWBHLx0HiC7FZU6gHt0T9M0U7bXyxZrHTWGaqZr8IRdsSIm5ml9TZaH+JYHyWlY0s7Lsr7RMw0ZMqU1z4TcvE8WrXdZcF+eGNoZGvUAnKNg==',key_name='tempest-keypair-1146512233',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:16:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb60c747fc434b8a8bb9a0df65970d92',ramdisk_id='',reservation_id='r-p3df4rdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1619345525',owner_user_name='tempest-AttachVolumeShelveTestJSON-1619345525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8074110936b461690a6518ddee180ac',uuid=ab749a19-fc12-4a97-9a7d-7a5410b2038d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converting VIF {"id": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "address": "fa:16:3e:e2:7f:e6", "network": {"id": "97080b5a-fd19-4a16-bc96-21d386fe3782", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-437485102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb60c747fc434b8a8bb9a0df65970d92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dcc40-7a", "ovs_interfaceid": "083dcc40-7aec-41be-81b9-aaad0c58aa1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG os_vif [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap083dcc40-7a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41a5d5e3-b4e4-4dff-9312-71f3c1fcfef6) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:01 user nova-compute[75453]: INFO os_vif [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:7f:e6,bridge_name='br-int',has_traffic_filtering=True,id=083dcc40-7aec-41be-81b9-aaad0c58aa1f,network=Network(97080b5a-fd19-4a16-bc96-21d386fe3782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dcc40-7a')
Nov 28 14:18:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Deleting instance files /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d_del
Nov 28 14:18:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Deletion of /opt/stack/data/nova/instances/ab749a19-fc12-4a97-9a7d-7a5410b2038d_del complete
Nov 28 14:18:02 user nova-compute[75453]: INFO nova.compute.manager [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 14:18:02 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:18:02 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:18:02 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:18:02 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:18:02 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Took 0.68 seconds to deallocate network for instance.
Nov 28 14:18:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:18:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:18:02 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:18:02 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:18:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:18:03 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Deleted allocations for instance ab749a19-fc12-4a97-9a7d-7a5410b2038d
Nov 28 14:18:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7133928f-4c47-462b-80b1-e8ec4cd126aa tempest-AttachVolumeShelveTestJSON-1619345525 tempest-AttachVolumeShelveTestJSON-1619345525-project-member] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:18:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:18:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] Acquiring lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:18:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:18:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] Lock "ab749a19-fc12-4a97-9a7d-7a5410b2038d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:18:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] No waiting events found dispatching network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:18:03 user nova-compute[75453]: WARNING nova.compute.manager [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received unexpected event network-vif-plugged-083dcc40-7aec-41be-81b9-aaad0c58aa1f for instance with vm_state deleted and task_state None.
Nov 28 14:18:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-2730bb11-b4e1-493f-84a4-5d56f3476a0a req-188e546e-0b53-432f-b90d-2cd81d2fb859 service nova] [instance: ab749a19-fc12-4a97-9a7d-7a5410b2038d] Received event network-vif-deleted-083dcc40-7aec-41be-81b9-aaad0c58aa1f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:18:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Going to confirm migration 2 {{(pid=75453) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquired lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG nova.network.neutron [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG nova.objects.instance [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'info_cache' on Instance uuid 9f9d0178-d8cd-4d99-930f-7d2f787e899a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG nova.network.neutron [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating instance_info_cache with network_info: [{"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Releasing lock "refresh_cache-9f9d0178-d8cd-4d99-930f-7d2f787e899a" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG nova.objects.instance [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'migration_context' on Instance uuid 9f9d0178-d8cd-4d99-930f-7d2f787e899a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG nova.objects.base [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Object Instance<9f9d0178-d8cd-4d99-930f-7d2f787e899a> lazy-loaded attributes: info_cache,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:18:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:08 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:18:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:18:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.280s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:18:08 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Deleted allocation for migration 499d0b2c-7a2a-4928-b780-fe8faad17079
Nov 28 14:18:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fefb1f28-04d6-40da-980d-3175a67e6a68 tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.416s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:18:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:18:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:18:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:18:21 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:18:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:18:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:18:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:18:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:18:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:18:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:18:22 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Updating instance_info_cache with network_info: [{"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:18:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:18:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:18:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:18:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:18:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:18:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:18:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:18:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:18:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:18:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:18:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:18:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:18:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:18:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8464MB free_disk=24.957218170166016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:18:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:18:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:18:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:18:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:18:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:18:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:18:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:18:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:19:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:19:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:19:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:19:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:19:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:14 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:19:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:18 user nova-compute[75453]: INFO nova.compute.manager [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Unrescuing
Nov 28 14:19:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:19:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquired lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:19:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Updating instance_info_cache with network_info: [{"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Releasing lock "refresh_cache-7e93e8e5-ec04-43bc-8c31-c03ef461cc62" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG nova.objects.instance [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'flavor' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-unplugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-unplugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:19:19 user nova-compute[75453]: WARNING nova.compute.manager [req-9cf03516-f3f2-4a73-b197-b9bcf0f7012d req-bcf97168-8af4-4273-bda1-04f8de567e3f service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-unplugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:19:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:20 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Instance destroyed successfully.
Nov 28 14:19:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:19:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:19:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:19:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:19:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:19:21 user nova-compute[75453]: WARNING nova.compute.manager [req-706894db-f039-458e-b882-03498fa219e0 req-46456ae6-4520-4b3c-8784-fedd39c858fc service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:19:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid b531830d-1e76-4b07-bed1-2b009e235382 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-60703df5-44e4-4ff0-94b1-e57eae85db78 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:19:23 user nova-compute[75453]: WARNING nova.compute.manager [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:19:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:19:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:19:23 user nova-compute[75453]: WARNING nova.compute.manager [req-b78504a3-a753-49d8-bd5f-74d5bca1759e req-3158728f-5b36-48fc-8944-1b76a6c07af3 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:19:24 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updating instance_info_cache with network_info: [{"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:19:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-b531830d-1e76-4b07-bed1-2b009e235382" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:19:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:19:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:19:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:19:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:19:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:19:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:19:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:19:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:19:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:19:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=24.955886840820312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:19:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:19:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:19:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:19:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:19:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:19:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:32 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:32 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:19:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:38 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:19:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:19:58 user nova-compute[75453]: INFO nova.compute.manager [None req-1f567a5c-77fa-49d2-8e11-18b18f7f2edd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Get console output
Nov 28 14:19:58 user nova-compute[75453]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 28 14:20:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:20:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:20:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:20:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:20:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:20:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:20:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:20:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:20:23 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:20:24 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updating instance_info_cache with network_info: [{"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:20:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:20:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:20:24 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:20:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:20:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:20:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:20:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:20:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:20:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:20:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:20:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:20:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8511MB free_disk=24.945144653320312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:20:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:20:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:33 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:20:33 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:20:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:20:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:20:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:20:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:20:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:20:58 user nova-compute[75453]: INFO nova.compute.manager [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Terminating instance
Nov 28 14:20:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:20:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-unplugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] No waiting events found dispatching network-vif-unplugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-98f5df55-5232-4f95-bda7-b4015f31cb65 req-8f5bf663-7672-465b-b4f0-4a5a0ed29201 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-unplugged-8ffe4343-b471-4fba-bd3b-676b3653941d for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:20:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Instance destroyed successfully.
Nov 28 14:20:59 user nova-compute[75453]: DEBUG nova.objects.instance [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'resources' on Instance uuid 9f9d0178-d8cd-4d99-930f-7d2f787e899a {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1596818341',display_name='tempest-ServerActionsTestOtherA-server-1596818341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1596818341',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g==',key_name='tempest-keypair-1318751346',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:16:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-s73uintr',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=9f9d0178-d8cd-4d99-930f-7d2f787e899a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "8ffe4343-b471-4fba-bd3b-676b3653941d", "address": "fa:16:3e:c4:0b:d2", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffe4343-b4", "ovs_interfaceid": "8ffe4343-b471-4fba-bd3b-676b3653941d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_vif [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ffe4343-b4, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2102c6a3-593b-471d-accd-912ebd91ba37) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:20:59 user nova-compute[75453]: INFO os_vif [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0b:d2,bridge_name='br-int',has_traffic_filtering=True,id=8ffe4343-b471-4fba-bd3b-676b3653941d,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffe4343-b4')
Nov 28 14:20:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGMlvmr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:20:59 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[212081b7-b091-4a7f-97dc-c47352883685]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:20:59 user nova-compute[75453]: No targets found.
Nov 28 14:20:59 user nova-compute[75453]: iSNS:
Nov 28 14:20:59 user nova-compute[75453]: No targets found.
Nov 28 14:20:59 user nova-compute[75453]: STATIC:
Nov 28 14:20:59 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878
Nov 28 14:20:59 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:20:59 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:20:59 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd
Nov 28 14:20:59 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:20:59 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:20:59 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:20:59 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:20:59 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:20:59 user nova-compute[75453]: FIRMWARE:
Nov 28 14:20:59 user nova-compute[75453]: No targets found.
Nov 28 14:20:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:20:59 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:20:59 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb01bedd-e0e6-4fad-a228-19afdf99645e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c10980-bc53-440b-a5c8-275858c52de2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:20:59 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:20:59 user nova-compute[75453]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:20:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:20:59 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:20:59 user nova-compute[75453]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 (non-flash)
Nov 28 14:20:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c724280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[16620c14-6bb5-4199-8207-8fdd6f771711]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4d5b51-8a21-47e6-b825-d82919ccbca4]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[526104dc-a09f-4d3b-b1ff-80d170709a88]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1bf7b6-035a-4796-9769-b01b61207c50]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfe7d7fd7-95ae4401a3ac8e9b', '/dev/disk/by-id/scsi-23935616534343031', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fe7d7fd7') {{(pid=86546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64c0284-1903-4dae-ad7a-775006a25397]: (4, None) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[610adae9-f66b-4905-9766-63e52cbd43b6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb120e8-d44a-4a96-99f6-85a4f72a4e6e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260]
Nov 28 14:20:59 user nova-compute[75453]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878, portal: 172.16.0.220,3260] successful.
Nov 28 14:20:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:20:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8b858-5204-4333-a839-2d585c38b878 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca56839d-3033-4229-8737-659d4ce6b62f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:21:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:21:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] <== disconnect_volume: return (310ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:21:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:21:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Deleting instance files /opt/stack/data/nova/instances/9f9d0178-d8cd-4d99-930f-7d2f787e899a_del
Nov 28 14:21:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Deletion of /opt/stack/data/nova/instances/9f9d0178-d8cd-4d99-930f-7d2f787e899a_del complete
Nov 28 14:21:00 user nova-compute[75453]: INFO nova.compute.manager [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 28 14:21:00 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:21:00 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:21:00 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:21:00 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:21:00 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Took 0.70 seconds to deallocate network for instance.
Nov 28 14:21:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-17bacfd9-4907-496e-b6e3-62b7edfa8899 req-6f1c2478-0f1c-45b7-9616-cb9be5140c91 service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-deleted-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] Acquiring lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] No waiting events found dispatching network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:21:01 user nova-compute[75453]: WARNING nova.compute.manager [req-5e881628-e107-4bd5-8356-e30a420d1a86 req-a5f0aeef-13fd-4b56-a566-66a4c8b9a5ad service nova] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Received unexpected event network-vif-plugged-8ffe4343-b471-4fba-bd3b-676b3653941d for instance with vm_state active and task_state deleting.
Nov 28 14:21:01 user nova-compute[75453]: INFO nova.compute.manager [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Took 0.83 seconds to detach 1 volumes for instance.
Nov 28 14:21:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: 9f9d0178-d8cd-4d99-930f-7d2f787e899a] Deleting volume: ffa8b858-5204-4333-a839-2d585c38b878 {{(pid=75453) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:21:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:02 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Deleted allocations for instance 9f9d0178-d8cd-4d99-930f-7d2f787e899a
Nov 28 14:21:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-abad8d67-3ea1-42bb-8692-08f744974eef tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "9f9d0178-d8cd-4d99-930f-7d2f787e899a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.209s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:09 user nova-compute[75453]: INFO nova.compute.manager [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Terminating instance
Nov 28 14:21:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-unplugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-unplugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-092c4881-5266-40e1-971a-fe3ec09adb87 req-92f43b2f-9350-415c-b49c-20022e53ed4e service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-unplugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Instance destroyed successfully.
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.objects.instance [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'resources' on Instance uuid 7e93e8e5-ec04-43bc-8c31-c03ef461cc62 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2115577482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2115577482',id=38,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:17:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-e6v4586r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:19:24Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=7e93e8e5-ec04-43bc-8c31-c03ef461cc62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "address": "fa:16:3e:c7:5d:9e", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8370c9d-f5", "ovs_interfaceid": "c8370c9d-f591-4a61-bce4-077c3a3b7ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5d:9e,bridge_name='br-int',has_traffic_filtering=True,id=c8370c9d-f591-4a61-bce4-077c3a3b7ff6,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8370c9d-f5') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_vif [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5d:9e,bridge_name='br-int',has_traffic_filtering=True,id=c8370c9d-f591-4a61-bce4-077c3a3b7ff6,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8370c9d-f5') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8370c9d-f5, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fef3724-dda0-4420-b631-7feac871e835) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:10 user nova-compute[75453]: INFO os_vif [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5d:9e,bridge_name='br-int',has_traffic_filtering=True,id=c8370c9d-f591-4a61-bce4-077c3a3b7ff6,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8370c9d-f5')
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlRoijes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:21:10 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d45201-e04d-4ee8-8cfb-30c4ce1806f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:21:10 user nova-compute[75453]: No targets found.
Nov 28 14:21:10 user nova-compute[75453]: iSNS:
Nov 28 14:21:10 user nova-compute[75453]: No targets found.
Nov 28 14:21:10 user nova-compute[75453]: STATIC:
Nov 28 14:21:10 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd
Nov 28 14:21:10 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:21:10 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:21:10 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:21:10 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:21:10 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:21:10 user nova-compute[75453]: FIRMWARE:
Nov 28 14:21:10 user nova-compute[75453]: No targets found.
Nov 28 14:21:10 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:21:10 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:21:10 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae553f8-ba93-45d1-b135-23f66bf13d49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[537ed25c-3261-4d38-8579-acf800c3882b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:21:10 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:21:10 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:21:10 user nova-compute[75453]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd (non-flash)
Nov 28 14:21:10 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f024c2a2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd'): ({'sdd'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Removing single pathed devices sdd {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ebdab-815f-44fd-96fc-2a1e21e8ee4f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e3bdce-f512-40da-8aac-70c45bf91f78]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flushing IO for device /dev/sdd {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1bb26b-61da-4ae1-bdf8-19719df64932]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[70759aa4-e959-40f3-a3ce-d1c2ceef490a]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] SCSI volumes sdd have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[094dacc6-ff61-4a6b-ba17-7f466ebd43c1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec47cf42-279b-48bd-b25c-37fa2f9ca29d]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd, portal: 172.16.0.220,3260]
Nov 28 14:21:10 user nova-compute[75453]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd, portal: 172.16.0.220,3260] successful.
Nov 28 14:21:10 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945f888e-cd33-435d-bf1c-285d8da969bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6bbf83-db93-45c2-9e24-3397dba267ad]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] <== disconnect_volume: return (288ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:21:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Deleting instance files /opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62_del
Nov 28 14:21:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Deletion of /opt/stack/data/nova/instances/7e93e8e5-ec04-43bc-8c31-c03ef461cc62_del complete
Nov 28 14:21:10 user nova-compute[75453]: INFO nova.compute.manager [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 28 14:21:10 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:21:10 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:21:11 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:21:11 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Took 0.45 seconds to deallocate network for instance.
Nov 28 14:21:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-239f059b-e823-4c0e-a568-a685b1ee84bd req-89a7d727-ce2f-45ce-a448-fc548a91817f service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-deleted-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:21:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:21:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] Acquiring lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] No waiting events found dispatching network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:21:12 user nova-compute[75453]: WARNING nova.compute.manager [req-c4ecbe3f-ddab-4400-ba2f-6909d36b2186 req-88f86faa-dcaf-4aa5-855d-79121a57b491 service nova] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Received unexpected event network-vif-plugged-c8370c9d-f591-4a61-bce4-077c3a3b7ff6 for instance with vm_state active and task_state deleting.
Nov 28 14:21:12 user nova-compute[75453]: INFO nova.compute.manager [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 7e93e8e5-ec04-43bc-8c31-c03ef461cc62] Took 0.73 seconds to detach 1 volumes for instance.
Nov 28 14:21:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:12 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:21:12 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:21:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:12 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Deleted allocations for instance 7e93e8e5-ec04-43bc-8c31-c03ef461cc62
Nov 28 14:21:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-10884ba3-3097-48c7-abc9-2182878ff32d tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "7e93e8e5-ec04-43bc-8c31-c03ef461cc62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.704s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:21:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:21:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:21:23 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:21:24 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updating instance_info_cache with network_info: [{"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:21:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-db5b1a94-7308-4e99-bc57-025611be1f23" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:21:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:21:24 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:24 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:21:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:25 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:21:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:21:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:21:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:21:27 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=24.94377899169922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b531830d-1e76-4b07-bed1-2b009e235382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:21:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:21:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:21:33 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:34 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:21:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:21:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:21:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:21:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:38 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_power_states {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid b531830d-1e76-4b07-bed1-2b009e235382 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 839b0b0f-101d-46ca-97a8-ab404cc35ea9 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "b531830d-1e76-4b07-bed1-2b009e235382" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "b531830d-1e76-4b07-bed1-2b009e235382" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "db5b1a94-7308-4e99-bc57-025611be1f23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "db5b1a94-7308-4e99-bc57-025611be1f23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "b531830d-1e76-4b07-bed1-2b009e235382" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "b531830d-1e76-4b07-bed1-2b009e235382" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "b531830d-1e76-4b07-bed1-2b009e235382" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "b531830d-1e76-4b07-bed1-2b009e235382-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:52 user nova-compute[75453]: INFO nova.compute.manager [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Terminating instance
Nov 28 14:21:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received event network-vif-unplugged-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] Acquiring lock "b531830d-1e76-4b07-bed1-2b009e235382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] No waiting events found dispatching network-vif-unplugged-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:21:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-a62f6f8f-7e72-4b15-b8fe-38092894ad12 req-2c4a633e-4ce3-4ec5-a4c6-83de0868ddc7 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received event network-vif-unplugged-f0bdc249-748c-4d50-82ce-ad985120d91f for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:21:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Instance destroyed successfully.
Nov 28 14:21:53 user nova-compute[75453]: DEBUG nova.objects.instance [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lazy-loading 'resources' on Instance uuid b531830d-1e76-4b07-bed1-2b009e235382 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-374540379',display_name='tempest-ServerActionsTestOtherA-server-374540379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-374540379',id=22,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5PDt7+9DSnheA9QKsuPv+CLt2WXpIwke/h+wTtU4XfxMwBhQfeHIlNF47iqKgkBiCitq7AOVap93TirqNKus9NJaDsY6/GLqAT5tr5rijg6f3fQxrKOETFJ90kg5S+g==',key_name='tempest-keypair-1318751346',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:03:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82ab030af40f43e28b5f1b7ce64c50a8',ramdisk_id='',reservation_id='r-jwd7amzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1445772683',owner_user_name='tempest-ServerActionsTestOtherA-1445772683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f84ee8a311d4619b7d51c2066d4775f',uuid=b531830d-1e76-4b07-bed1-2b009e235382,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converting VIF {"id": "f0bdc249-748c-4d50-82ce-ad985120d91f", "address": "fa:16:3e:4b:07:bc", "network": {"id": "adaa1566-e3ce-4ef9-bb92-0934c59e030e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1861306989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82ab030af40f43e28b5f1b7ce64c50a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0bdc249-74", "ovs_interfaceid": "f0bdc249-748c-4d50-82ce-ad985120d91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:07:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0bdc249-748c-4d50-82ce-ad985120d91f,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdc249-74') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG os_vif [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:07:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0bdc249-748c-4d50-82ce-ad985120d91f,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdc249-74') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0bdc249-74, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d045ad82-e475-4f14-b6cd-54900dc35214) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:21:53 user nova-compute[75453]: INFO os_vif [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:07:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0bdc249-748c-4d50-82ce-ad985120d91f,network=Network(adaa1566-e3ce-4ef9-bb92-0934c59e030e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0bdc249-74')
Nov 28 14:21:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Deleting instance files /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382_del
Nov 28 14:21:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Deletion of /opt/stack/data/nova/instances/b531830d-1e76-4b07-bed1-2b009e235382_del complete
Nov 28 14:21:53 user nova-compute[75453]: INFO nova.compute.manager [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 14:21:53 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:21:53 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: b531830d-1e76-4b07-bed1-2b009e235382] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:21:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:21:54 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:21:54 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Took 0.63 seconds to deallocate network for instance.
Nov 28 14:21:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-d60ec59c-f308-44ce-be47-c54d886372f9 req-1c745f90-37a1-4c8a-84cd-e19390eed671 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received event network-vif-deleted-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:21:54 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:21:54 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:21:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:54 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Deleted allocations for instance b531830d-1e76-4b07-bed1-2b009e235382
Nov 28 14:21:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8ba9e600-1f73-4e5b-bc5b-45139b847ddd tempest-ServerActionsTestOtherA-1445772683 tempest-ServerActionsTestOtherA-1445772683-project-member] Lock "b531830d-1e76-4b07-bed1-2b009e235382" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received event network-vif-plugged-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:21:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] Acquiring lock "b531830d-1e76-4b07-bed1-2b009e235382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:21:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:21:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] Lock "b531830d-1e76-4b07-bed1-2b009e235382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:21:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] No waiting events found dispatching network-vif-plugged-f0bdc249-748c-4d50-82ce-ad985120d91f {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:21:55 user nova-compute[75453]: WARNING nova.compute.manager [req-20154926-663f-4717-9748-21998008bcc6 req-50aa7b4c-e3a3-4c93-937b-cf4b0add45b4 service nova] [instance: b531830d-1e76-4b07-bed1-2b009e235382] Received unexpected event network-vif-plugged-f0bdc249-748c-4d50-82ce-ad985120d91f for instance with vm_state deleted and task_state None.
Nov 28 14:21:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:00 user nova-compute[75453]: INFO nova.compute.manager [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Terminating instance
Nov 28 14:22:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:22:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Instance destroyed successfully.
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'resources' on Instance uuid eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1916015322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1916015322',id=36,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:12:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-mabzn0p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:14:35Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "54df673e-4fe7-4894-b18f-ed5dc483d516", "address": "fa:16:3e:33:d7:02", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54df673e-4f", "ovs_interfaceid": "54df673e-4fe7-4894-b18f-ed5dc483d516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=54df673e-4fe7-4894-b18f-ed5dc483d516,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54df673e-4f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG os_vif [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=54df673e-4fe7-4894-b18f-ed5dc483d516,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54df673e-4f') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54df673e-4f, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f89f38af-b9e0-4fa9-8c67-35408b58dea5) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:22:01 user nova-compute[75453]: INFO os_vif [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:d7:02,bridge_name='br-int',has_traffic_filtering=True,id=54df673e-4fe7-4894-b18f-ed5dc483d516,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54df673e-4f')
Nov 28 14:22:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Deleting instance files /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0_del
Nov 28 14:22:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Deletion of /opt/stack/data/nova/instances/eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0_del complete
Nov 28 14:22:01 user nova-compute[75453]: INFO nova.compute.manager [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 28 14:22:01 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received event network-vif-unplugged-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] Acquiring lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] No waiting events found dispatching network-vif-unplugged-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-a824f346-9539-4436-90ed-2aacbc167060 req-964ba558-3ff1-43b9-97c2-f00ea2f15cf7 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received event network-vif-unplugged-54df673e-4fe7-4894-b18f-ed5dc483d516 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:22:01 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Took 0.61 seconds to deallocate network for instance.
Nov 28 14:22:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:02 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:22:02 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:22:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:02 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Deleted allocations for instance eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0
Nov 28 14:22:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d5e49f40-f32e-4134-9e0e-560132b2d9c7 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.610s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received event network-vif-plugged-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:22:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] Acquiring lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] Lock "eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] No waiting events found dispatching network-vif-plugged-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:22:03 user nova-compute[75453]: WARNING nova.compute.manager [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received unexpected event network-vif-plugged-54df673e-4fe7-4894-b18f-ed5dc483d516 for instance with vm_state deleted and task_state None.
Nov 28 14:22:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-31ea161e-c2fb-432c-ba08-047a8946cd13 req-54b0854d-deab-48a9-a813-a9cbe6a96722 service nova] [instance: eda2c65b-6cc9-4dab-9d0f-d5bf1b4b7ac0] Received event network-vif-deleted-54df673e-4fe7-4894-b18f-ed5dc483d516 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:22:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:22:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:22:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:22:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:22:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:22:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:22:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:22:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:22:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:22:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:22:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:22:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:22:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:28 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:22:28 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:22:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=25.096046447753906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance db5b1a94-7308-4e99-bc57-025611be1f23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:22:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:34 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:22:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:22:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:22:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "db5b1a94-7308-4e99-bc57-025611be1f23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:51 user nova-compute[75453]: INFO nova.compute.manager [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Terminating instance
Nov 28 14:22:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:22:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-unplugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-unplugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-d9000651-44fa-4a65-acdb-091985c8810c req-5c8753a1-5ae1-4b90-b9ce-0a25c4541e68 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-unplugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Instance destroyed successfully.
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.objects.instance [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'resources' on Instance uuid db5b1a94-7308-4e99-bc57-025611be1f23 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1272274120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1272274120',id=32,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:09:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-qjub5cqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:10:51Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=db5b1a94-7308-4e99-bc57-025611be1f23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "address": "fa:16:3e:f5:2b:72", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6df96a1-9f", "ovs_interfaceid": "f6df96a1-9fa2-447c-b0f6-9f53f1521839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=f6df96a1-9fa2-447c-b0f6-9f53f1521839,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6df96a1-9f') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_vif [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=f6df96a1-9fa2-447c-b0f6-9f53f1521839,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6df96a1-9f') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6df96a1-9f, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6ab7e64-6ed7-40e3-8521-60df620ddd12) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:22:52 user nova-compute[75453]: INFO os_vif [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:2b:72,bridge_name='br-int',has_traffic_filtering=True,id=f6df96a1-9fa2-447c-b0f6-9f53f1521839,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6df96a1-9f')
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMaiwmKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:22:52 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ff10ef-58a9-4e8b-b225-de7e85d8f2bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:22:52 user nova-compute[75453]: No targets found.
Nov 28 14:22:52 user nova-compute[75453]: iSNS:
Nov 28 14:22:52 user nova-compute[75453]: No targets found.
Nov 28 14:22:52 user nova-compute[75453]: STATIC:
Nov 28 14:22:52 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0
Nov 28 14:22:52 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:22:52 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:22:52 user nova-compute[75453]: FIRMWARE:
Nov 28 14:22:52 user nova-compute[75453]: No targets found.
Nov 28 14:22:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:22:52 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:22:52 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[831c61db-e385-4ec3-aa32-9958b0a3f698]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42cfcda-8bf6-4945-b7eb-f62574d12f2e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:22:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 (non-flash)
Nov 28 14:22:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c54e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96e61fd-2943-454a-93a2-af6b28010a93]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e098e7d0-5db7-417b-be01-d9bdfc9774e5]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5837aa43-51ef-4f6d-ad69-f5078ee0bc2c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e833e09a-cb61-4df8-b6b9-e72d11c3cd95]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[835a27a3-d81d-4f4c-a8c5-ffe4169dac19]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fbf908-c4ec-4293-b561-5f07e1c3d90b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0, portal: 172.16.0.220,3260]
Nov 28 14:22:52 user nova-compute[75453]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0, portal: 172.16.0.220,3260] successful.
Nov 28 14:22:52 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec03014f-39a5-4b50-b96b-76fabf658cb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[554136fb-c893-418c-a0f9-dc6b2b8047d6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] <== disconnect_volume: return (284ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:22:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Deleting instance files /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23_del
Nov 28 14:22:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Deletion of /opt/stack/data/nova/instances/db5b1a94-7308-4e99-bc57-025611be1f23_del complete
Nov 28 14:22:52 user nova-compute[75453]: INFO nova.compute.manager [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 28 14:22:52 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:22:52 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:22:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:53 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:22:53 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Took 0.45 seconds to deallocate network for instance.
Nov 28 14:22:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:22:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] Acquiring lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] Lock "db5b1a94-7308-4e99-bc57-025611be1f23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] No waiting events found dispatching network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:22:54 user nova-compute[75453]: WARNING nova.compute.manager [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received unexpected event network-vif-plugged-f6df96a1-9fa2-447c-b0f6-9f53f1521839 for instance with vm_state active and task_state deleting.
Nov 28 14:22:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-9d94b8af-6bd8-438c-8bda-07ba8008f678 req-8207e04b-acff-4796-b94b-086cb5b434f8 service nova] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Received event network-vif-deleted-f6df96a1-9fa2-447c-b0f6-9f53f1521839 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:22:54 user nova-compute[75453]: INFO nova.compute.manager [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: db5b1a94-7308-4e99-bc57-025611be1f23] Took 0.78 seconds to detach 1 volumes for instance.
Nov 28 14:22:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:54 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:22:54 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:22:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:54 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Deleted allocations for instance db5b1a94-7308-4e99-bc57-025611be1f23
Nov 28 14:22:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-23014d80-60b2-4690-b8e6-4502a21da6f5 tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "db5b1a94-7308-4e99-bc57-025611be1f23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:22:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:56 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:22:56 user nova-compute[75453]: INFO nova.compute.claims [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Claim successful on node user
Nov 28 14:22:56 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:22:56 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:22:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.network.neutron [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:22:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.policy [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7fff3e3f0754abc82c9d66c0fbf7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba09555cf7f34e3fa050dec089a4da7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:22:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Creating image(s)
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.167s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk 1073741824" returned: 0 in 0.052s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.network.neutron [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Successfully created port: a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Cannot resize image /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Ensure instance console log exists: /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:22:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Successfully updated port: a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-changed-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Refreshing instance network info cache due to event network-changed-a5aaa001-eb54-42bf-b66f-537eafd16a55. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Instance network_info: |[{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.network.neutron [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Refreshing network info cache for port a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Start _get_guest_xml network_info=[{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:22:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:22:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1180311090',display_name='tempest-ServerStableDeviceRescueTest-server-1180311090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1180311090',id=39,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNvuS2G8T5YKELo2dJZ1hzfLKF7JYYyYTzxTnjYdok9t2F2vVjtP+g2P4mF9wy0UwkcFoeeu9dEjxztEjVxbCg0v5oALXWq66oanhAu2rY/frvgB0RqoDNfiiDQAQ1dTw==',key_name='tempest-keypair-1086921736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba09555cf7f34e3fa050dec089a4da7a',ramdisk_id='',reservation_id='r-2qmhpi8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2057378686',owner_user_name='tempest-ServerStableDeviceRescueTest-2057378686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7fff3e3f0754abc82c9d66c0fbf7527',uuid=eb3f8527-e81e-495a-8a3c-a7d8ee805b5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Converting VIF {"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:fb:5c,bridge_name='br-int',has_traffic_filtering=True,id=a5aaa001-eb54-42bf-b66f-537eafd16a55,network=Network(5d207296-8c9c-436e-abd5-9a920c76f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aaa001-eb') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'pci_devices' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:22:58 user nova-compute[75453]:   <uuid>eb3f8527-e81e-495a-8a3c-a7d8ee805b5c</uuid>
Nov 28 14:22:58 user nova-compute[75453]:   <name>instance-00000027</name>
Nov 28 14:22:58 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:22:58 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:22:58 user nova-compute[75453]:   <metadata>
Nov 28 14:22:58 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:22:58 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:22:58 user nova-compute[75453]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1180311090</nova:name>
Nov 28 14:22:58 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:22:58</nova:creationTime>
Nov 28 14:22:58 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:22:58 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:22:58 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:22:58 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:22:58 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:22:58 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:22:58 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:22:58 user nova-compute[75453]:       <nova:owner>
Nov 28 14:22:58 user nova-compute[75453]:         <nova:user uuid="c7fff3e3f0754abc82c9d66c0fbf7527">tempest-ServerStableDeviceRescueTest-2057378686-project-member</nova:user>
Nov 28 14:22:58 user nova-compute[75453]:         <nova:project uuid="ba09555cf7f34e3fa050dec089a4da7a">tempest-ServerStableDeviceRescueTest-2057378686</nova:project>
Nov 28 14:22:58 user nova-compute[75453]:       </nova:owner>
Nov 28 14:22:58 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:22:58 user nova-compute[75453]:       <nova:ports>
Nov 28 14:22:58 user nova-compute[75453]:         <nova:port uuid="a5aaa001-eb54-42bf-b66f-537eafd16a55">
Nov 28 14:22:58 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 14:22:58 user nova-compute[75453]:         </nova:port>
Nov 28 14:22:58 user nova-compute[75453]:       </nova:ports>
Nov 28 14:22:58 user nova-compute[75453]:     </nova:instance>
Nov 28 14:22:58 user nova-compute[75453]:   </metadata>
Nov 28 14:22:58 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:22:58 user nova-compute[75453]:     <system>
Nov 28 14:22:58 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:22:58 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:22:58 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:22:58 user nova-compute[75453]:       <entry name="serial">eb3f8527-e81e-495a-8a3c-a7d8ee805b5c</entry>
Nov 28 14:22:58 user nova-compute[75453]:       <entry name="uuid">eb3f8527-e81e-495a-8a3c-a7d8ee805b5c</entry>
Nov 28 14:22:58 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:22:58 user nova-compute[75453]:     </system>
Nov 28 14:22:58 user nova-compute[75453]:   </sysinfo>
Nov 28 14:22:58 user nova-compute[75453]:   <os>
Nov 28 14:22:58 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:22:58 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:22:58 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:22:58 user nova-compute[75453]:   </os>
Nov 28 14:22:58 user nova-compute[75453]:   <features>
Nov 28 14:22:58 user nova-compute[75453]:     <acpi/>
Nov 28 14:22:58 user nova-compute[75453]:     <apic/>
Nov 28 14:22:58 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:22:58 user nova-compute[75453]:   </features>
Nov 28 14:22:58 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:22:58 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:22:58 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:22:58 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:22:58 user nova-compute[75453]:   </clock>
Nov 28 14:22:58 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:22:58 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:22:58 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:22:58 user nova-compute[75453]:   </cpu>
Nov 28 14:22:58 user nova-compute[75453]:   <devices>
Nov 28 14:22:58 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:22:58 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:22:58 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk"/>
Nov 28 14:22:58 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:22:58 user nova-compute[75453]:     </disk>
Nov 28 14:22:58 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:22:58 user nova-compute[75453]:       <mac address="fa:16:3e:cc:fb:5c"/>
Nov 28 14:22:58 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:22:58 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:22:58 user nova-compute[75453]:       <target dev="tapa5aaa001-eb"/>
Nov 28 14:22:58 user nova-compute[75453]:     </interface>
Nov 28 14:22:58 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:22:58 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/console.log" append="off"/>
Nov 28 14:22:58 user nova-compute[75453]:     </serial>
Nov 28 14:22:58 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:22:58 user nova-compute[75453]:     <video>
Nov 28 14:22:58 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:22:58 user nova-compute[75453]:     </video>
Nov 28 14:22:58 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:22:58 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:22:58 user nova-compute[75453]:     </rng>
Nov 28 14:22:58 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:22:58 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:22:58 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:22:58 user nova-compute[75453]:     </memballoon>
Nov 28 14:22:58 user nova-compute[75453]:   </devices>
Nov 28 14:22:58 user nova-compute[75453]: </domain>
Nov 28 14:22:58 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1180311090',display_name='tempest-ServerStableDeviceRescueTest-server-1180311090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1180311090',id=39,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNvuS2G8T5YKELo2dJZ1hzfLKF7JYYyYTzxTnjYdok9t2F2vVjtP+g2P4mF9wy0UwkcFoeeu9dEjxztEjVxbCg0v5oALXWq66oanhAu2rY/frvgB0RqoDNfiiDQAQ1dTw==',key_name='tempest-keypair-1086921736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba09555cf7f34e3fa050dec089a4da7a',ramdisk_id='',reservation_id='r-2qmhpi8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2057378686',owner_user_name='tempest-ServerStableDeviceRescueTest-2057378686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7fff3e3f0754abc82c9d66c0fbf7527',uuid=eb3f8527-e81e-495a-8a3c-a7d8ee805b5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Converting VIF {"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:fb:5c,bridge_name='br-int',has_traffic_filtering=True,id=a5aaa001-eb54-42bf-b66f-537eafd16a55,network=Network(5d207296-8c9c-436e-abd5-9a920c76f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aaa001-eb') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG os_vif [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:fb:5c,bridge_name='br-int',has_traffic_filtering=True,id=a5aaa001-eb54-42bf-b66f-537eafd16a55,network=Network(5d207296-8c9c-436e-abd5-9a920c76f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aaa001-eb') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb1ea211-45f2-5379-b521-55c4c6d7fa4d', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5aaa001-eb, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5aaa001-eb, col_values=(('qos', UUID('a6f198f6-109d-4c3e-b1b9-b7762a3112cd')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5aaa001-eb, col_values=(('external_ids', {'iface-id': 'a5aaa001-eb54-42bf-b66f-537eafd16a55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:fb:5c', 'vm-uuid': 'eb3f8527-e81e-495a-8a3c-a7d8ee805b5c'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:22:58 user nova-compute[75453]: INFO os_vif [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:fb:5c,bridge_name='br-int',has_traffic_filtering=True,id=a5aaa001-eb54-42bf-b66f-537eafd16a55,network=Network(5d207296-8c9c-436e-abd5-9a920c76f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aaa001-eb')
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:22:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] No VIF found with MAC fa:16:3e:cc:fb:5c, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:22:59 user nova-compute[75453]: DEBUG nova.network.neutron [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updated VIF entry in instance network info cache for port a5aaa001-eb54-42bf-b66f-537eafd16a55. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:22:59 user nova-compute[75453]: DEBUG nova.network.neutron [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:22:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-122f2c2c-4eab-47a8-bc53-4846c16d074d req-5fa73c61-4328-471b-9608-22eaf89531e7 service nova] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:23:00 user nova-compute[75453]: WARNING nova.compute.manager [req-002c0142-2692-4358-80f2-eb1aff152b1e req-f42a8629-9b49-4381-9263-d7982cec0fcc service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state building and task_state spawning.
Nov 28 14:23:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:23:02 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Instance spawned successfully.
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:23:02 user nova-compute[75453]: WARNING nova.compute.manager [req-2a8a80ab-d51a-46c2-a14d-3b39426b9767 req-4a1879d2-4d59-4962-9533-00518bc6a3f1 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state building and task_state spawning.
Nov 28 14:23:02 user nova-compute[75453]: INFO nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 28 14:23:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:23:02 user nova-compute[75453]: INFO nova.compute.manager [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Took 5.73 seconds to build instance.
Nov 28 14:23:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-efe8b4c9-0f38-4968-b558-16cbeb0be862 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.825s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 839b0b0f-101d-46ca-97a8-ab404cc35ea9 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updating instance_info_cache with network_info: [{"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-839b0b0f-101d-46ca-97a8-ab404cc35ea9" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:23:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:23:28 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:23:28 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:23:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.065753936767578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:23:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:30 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:34 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:38 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:23:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:23:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:23:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:23:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:23:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:42 user nova-compute[75453]: INFO nova.compute.manager [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Terminating instance
Nov 28 14:23:42 user nova-compute[75453]: DEBUG nova.compute.manager [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received event network-vif-unplugged-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] Acquiring lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] No waiting events found dispatching network-vif-unplugged-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:23:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-9c235911-7ea4-4e98-aa96-c05e6b5dba60 req-51ade76c-5595-4759-845a-aa39db0eab3e service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received event network-vif-unplugged-51520e6e-9061-4b7f-8860-53b7cfa9028a for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:23:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Instance destroyed successfully.
Nov 28 14:23:43 user nova-compute[75453]: DEBUG nova.objects.instance [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lazy-loading 'resources' on Instance uuid 839b0b0f-101d-46ca-97a8-ab404cc35ea9 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:04:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-441434432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-441434432',id=23,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de3b398da714d8cb92fad7f64d5c64e',ramdisk_id='',reservation_id='r-aqanvuny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-682344680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:06:02Z,user_data=None,user_id='f88c92554f0f44b0be661aa40aec8670',uuid=839b0b0f-101d-46ca-97a8-ab404cc35ea9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converting VIF {"id": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "address": "fa:16:3e:9e:92:97", "network": {"id": "3bfd3351-2c37-456a-b7b8-e306bd80afb4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1222657679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de3b398da714d8cb92fad7f64d5c64e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51520e6e-90", "ovs_interfaceid": "51520e6e-9061-4b7f-8860-53b7cfa9028a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:92:97,bridge_name='br-int',has_traffic_filtering=True,id=51520e6e-9061-4b7f-8860-53b7cfa9028a,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51520e6e-90') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG os_vif [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:92:97,bridge_name='br-int',has_traffic_filtering=True,id=51520e6e-9061-4b7f-8860-53b7cfa9028a,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51520e6e-90') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51520e6e-90, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e907113-dde0-416e-9891-f36cfa18a93d) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:23:43 user nova-compute[75453]: INFO os_vif [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:92:97,bridge_name='br-int',has_traffic_filtering=True,id=51520e6e-9061-4b7f-8860-53b7cfa9028a,network=Network(3bfd3351-2c37-456a-b7b8-e306bd80afb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51520e6e-90')
Nov 28 14:23:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Deleting instance files /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9_del
Nov 28 14:23:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Deletion of /opt/stack/data/nova/instances/839b0b0f-101d-46ca-97a8-ab404cc35ea9_del complete
Nov 28 14:23:43 user nova-compute[75453]: INFO nova.compute.manager [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 28 14:23:43 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:23:43 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Took 0.50 seconds to deallocate network for instance.
Nov 28 14:23:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:23:43 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:23:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:44 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Deleted allocations for instance 839b0b0f-101d-46ca-97a8-ab404cc35ea9
Nov 28 14:23:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9facac09-53be-4f43-a60a-0363044039da tempest-ServerBootFromVolumeStableRescueTest-682344680 tempest-ServerBootFromVolumeStableRescueTest-682344680-project-member] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.659s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received event network-vif-plugged-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:23:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] Acquiring lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:23:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:23:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] Lock "839b0b0f-101d-46ca-97a8-ab404cc35ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:23:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] No waiting events found dispatching network-vif-plugged-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:23:44 user nova-compute[75453]: WARNING nova.compute.manager [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received unexpected event network-vif-plugged-51520e6e-9061-4b7f-8860-53b7cfa9028a for instance with vm_state deleted and task_state None.
Nov 28 14:23:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-3a13135d-54ea-4535-baa8-7523455ac5bb req-7e217c14-a826-4d89-a2aa-4739cf6f9fe6 service nova] [instance: 839b0b0f-101d-46ca-97a8-ab404cc35ea9] Received event network-vif-deleted-51520e6e-9061-4b7f-8860-53b7cfa9028a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:23:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:23:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:23:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:24:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:24:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:24:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:24:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:24:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:24:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:24:19 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:24:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:24 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:24:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:24:26 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:24:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:24:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:24:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:24:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:24:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:24:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:24:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:24:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:24:27 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:24:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:24:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:24:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:24:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:29 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:24:29 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:24:29 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=25.190101623535156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:24:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:24:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:24:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:38 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:24:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:24:43 user nova-compute[75453]: INFO nova.compute.claims [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Claim successful on node user
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:24:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.policy [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:24:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Creating image(s)
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:24:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:24:44 user nova-compute[75453]: INFO nova.compute.claims [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Claim successful on node user
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk 1073741824" returned: 0 in 0.053s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.201s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:24:44 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Successfully created port: 3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Cannot resize image /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Ensure instance console log exists: /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.policy [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:24:44 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Creating image(s)
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk 1073741824" returned: 0 in 0.049s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Successfully updated port: 3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Successfully created port: 13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-changed-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Refreshing instance network info cache due to event network-changed-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] Acquiring lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] Acquired lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Refreshing network info cache for port 3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2845d615-c26c-415d-8b22-f3d581d9775d req-66444a7b-99c5-403d-8abe-4752446de344 service nova] Releasing lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquired lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Cannot resize image /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Ensure instance console log exists: /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Releasing lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance network_info: |[{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Start _get_guest_xml network_info=[{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Successfully updated port: 13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:24:45 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:24:45 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquired lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1751051532',display_name='tempest-ServerRescueNegativeTestJSON-server-1751051532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1751051532',id=40,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-o8acmmwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:24:44Z,user_data=None,user_id='7ac79717e12544d39215874f9b99ccf2',uuid=23f4cfb9-18d6-419b-9fb0-23a0da9da00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:f4:fe,bridge_name='br-int',has_traffic_filtering=True,id=3690b5db-09a7-4666-acc2-ef6d7d0ce3ed,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3690b5db-09') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.objects.instance [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'pci_devices' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:24:45 user nova-compute[75453]:   <uuid>23f4cfb9-18d6-419b-9fb0-23a0da9da00f</uuid>
Nov 28 14:24:45 user nova-compute[75453]:   <name>instance-00000028</name>
Nov 28 14:24:45 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:24:45 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:24:45 user nova-compute[75453]:   <metadata>
Nov 28 14:24:45 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:24:45 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:24:45 user nova-compute[75453]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1751051532</nova:name>
Nov 28 14:24:45 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:24:45</nova:creationTime>
Nov 28 14:24:45 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:24:45 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:24:45 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:24:45 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:24:45 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:24:45 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:24:45 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:24:45 user nova-compute[75453]:       <nova:owner>
Nov 28 14:24:45 user nova-compute[75453]:         <nova:user uuid="7ac79717e12544d39215874f9b99ccf2">tempest-ServerRescueNegativeTestJSON-1690568266-project-member</nova:user>
Nov 28 14:24:45 user nova-compute[75453]:         <nova:project uuid="c90c4a02d30c48c7b6ee993b9b213c2b">tempest-ServerRescueNegativeTestJSON-1690568266</nova:project>
Nov 28 14:24:45 user nova-compute[75453]:       </nova:owner>
Nov 28 14:24:45 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:24:45 user nova-compute[75453]:       <nova:ports>
Nov 28 14:24:45 user nova-compute[75453]:         <nova:port uuid="3690b5db-09a7-4666-acc2-ef6d7d0ce3ed">
Nov 28 14:24:45 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 14:24:45 user nova-compute[75453]:         </nova:port>
Nov 28 14:24:45 user nova-compute[75453]:       </nova:ports>
Nov 28 14:24:45 user nova-compute[75453]:     </nova:instance>
Nov 28 14:24:45 user nova-compute[75453]:   </metadata>
Nov 28 14:24:45 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:24:45 user nova-compute[75453]:     <system>
Nov 28 14:24:45 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:24:45 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:24:45 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:24:45 user nova-compute[75453]:       <entry name="serial">23f4cfb9-18d6-419b-9fb0-23a0da9da00f</entry>
Nov 28 14:24:45 user nova-compute[75453]:       <entry name="uuid">23f4cfb9-18d6-419b-9fb0-23a0da9da00f</entry>
Nov 28 14:24:45 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:24:45 user nova-compute[75453]:     </system>
Nov 28 14:24:45 user nova-compute[75453]:   </sysinfo>
Nov 28 14:24:45 user nova-compute[75453]:   <os>
Nov 28 14:24:45 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:24:45 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:24:45 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:24:45 user nova-compute[75453]:   </os>
Nov 28 14:24:45 user nova-compute[75453]:   <features>
Nov 28 14:24:45 user nova-compute[75453]:     <acpi/>
Nov 28 14:24:45 user nova-compute[75453]:     <apic/>
Nov 28 14:24:45 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:24:45 user nova-compute[75453]:   </features>
Nov 28 14:24:45 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:24:45 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:24:45 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:24:45 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:24:45 user nova-compute[75453]:   </clock>
Nov 28 14:24:45 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:24:45 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:24:45 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:24:45 user nova-compute[75453]:   </cpu>
Nov 28 14:24:45 user nova-compute[75453]:   <devices>
Nov 28 14:24:45 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:24:45 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:24:45 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk"/>
Nov 28 14:24:45 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:24:45 user nova-compute[75453]:     </disk>
Nov 28 14:24:45 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:24:45 user nova-compute[75453]:       <mac address="fa:16:3e:61:f4:fe"/>
Nov 28 14:24:45 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:24:45 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:24:45 user nova-compute[75453]:       <target dev="tap3690b5db-09"/>
Nov 28 14:24:45 user nova-compute[75453]:     </interface>
Nov 28 14:24:45 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:24:45 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/console.log" append="off"/>
Nov 28 14:24:45 user nova-compute[75453]:     </serial>
Nov 28 14:24:45 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:24:45 user nova-compute[75453]:     <video>
Nov 28 14:24:45 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:24:45 user nova-compute[75453]:     </video>
Nov 28 14:24:45 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:24:45 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:24:45 user nova-compute[75453]:     </rng>
Nov 28 14:24:45 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:24:45 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:24:45 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:24:45 user nova-compute[75453]:     </memballoon>
Nov 28 14:24:45 user nova-compute[75453]:   </devices>
Nov 28 14:24:45 user nova-compute[75453]: </domain>
Nov 28 14:24:45 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1751051532',display_name='tempest-ServerRescueNegativeTestJSON-server-1751051532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1751051532',id=40,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-o8acmmwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:24:44Z,user_data=None,user_id='7ac79717e12544d39215874f9b99ccf2',uuid=23f4cfb9-18d6-419b-9fb0-23a0da9da00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:f4:fe,bridge_name='br-int',has_traffic_filtering=True,id=3690b5db-09a7-4666-acc2-ef6d7d0ce3ed,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3690b5db-09') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG os_vif [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:f4:fe,bridge_name='br-int',has_traffic_filtering=True,id=3690b5db-09a7-4666-acc2-ef6d7d0ce3ed,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3690b5db-09') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd713a17-872f-5b20-a05a-fd840657eb16', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3690b5db-09, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3690b5db-09, col_values=(('qos', UUID('b1ba90ed-3ff6-42e5-8082-78a6d083e428')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3690b5db-09, col_values=(('external_ids', {'iface-id': '3690b5db-09a7-4666-acc2-ef6d7d0ce3ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:f4:fe', 'vm-uuid': '23f4cfb9-18d6-419b-9fb0-23a0da9da00f'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-changed-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Refreshing instance network info cache due to event network-changed-13b2b5c8-da0f-4c65-a267-199ae324844d. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] Acquiring lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:45 user nova-compute[75453]: INFO os_vif [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:f4:fe,bridge_name='br-int',has_traffic_filtering=True,id=3690b5db-09a7-4666-acc2-ef6d7d0ce3ed,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3690b5db-09')
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:24:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No VIF found with MAC fa:16:3e:61:f4:fe, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.network.neutron [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updating instance_info_cache with network_info: [{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Releasing lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Instance network_info: |[{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] Acquired lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Refreshing network info cache for port 13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Start _get_guest_xml network_info=[{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:24:46 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:24:46 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1897090922',display_name='tempest-ServerRescueNegativeTestJSON-server-1897090922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1897090922',id=41,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-0rftpo3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:24:45Z,user_data=None,user_id='7ac79717e12544d39215874f9b99ccf2',uuid=b1db2136-7fba-4701-bbc0-afee6b009a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:77:44,bridge_name='br-int',has_traffic_filtering=True,id=13b2b5c8-da0f-4c65-a267-199ae324844d,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b2b5c8-da') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'pci_devices' on Instance uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:24:46 user nova-compute[75453]:   <uuid>b1db2136-7fba-4701-bbc0-afee6b009a3c</uuid>
Nov 28 14:24:46 user nova-compute[75453]:   <name>instance-00000029</name>
Nov 28 14:24:46 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:24:46 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:24:46 user nova-compute[75453]:   <metadata>
Nov 28 14:24:46 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:24:46 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:24:46 user nova-compute[75453]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1897090922</nova:name>
Nov 28 14:24:46 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:24:46</nova:creationTime>
Nov 28 14:24:46 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:24:46 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:24:46 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:24:46 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:24:46 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:24:46 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:24:46 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:24:46 user nova-compute[75453]:       <nova:owner>
Nov 28 14:24:46 user nova-compute[75453]:         <nova:user uuid="7ac79717e12544d39215874f9b99ccf2">tempest-ServerRescueNegativeTestJSON-1690568266-project-member</nova:user>
Nov 28 14:24:46 user nova-compute[75453]:         <nova:project uuid="c90c4a02d30c48c7b6ee993b9b213c2b">tempest-ServerRescueNegativeTestJSON-1690568266</nova:project>
Nov 28 14:24:46 user nova-compute[75453]:       </nova:owner>
Nov 28 14:24:46 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:24:46 user nova-compute[75453]:       <nova:ports>
Nov 28 14:24:46 user nova-compute[75453]:         <nova:port uuid="13b2b5c8-da0f-4c65-a267-199ae324844d">
Nov 28 14:24:46 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 14:24:46 user nova-compute[75453]:         </nova:port>
Nov 28 14:24:46 user nova-compute[75453]:       </nova:ports>
Nov 28 14:24:46 user nova-compute[75453]:     </nova:instance>
Nov 28 14:24:46 user nova-compute[75453]:   </metadata>
Nov 28 14:24:46 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:24:46 user nova-compute[75453]:     <system>
Nov 28 14:24:46 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:24:46 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:24:46 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:24:46 user nova-compute[75453]:       <entry name="serial">b1db2136-7fba-4701-bbc0-afee6b009a3c</entry>
Nov 28 14:24:46 user nova-compute[75453]:       <entry name="uuid">b1db2136-7fba-4701-bbc0-afee6b009a3c</entry>
Nov 28 14:24:46 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:24:46 user nova-compute[75453]:     </system>
Nov 28 14:24:46 user nova-compute[75453]:   </sysinfo>
Nov 28 14:24:46 user nova-compute[75453]:   <os>
Nov 28 14:24:46 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:24:46 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:24:46 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:24:46 user nova-compute[75453]:   </os>
Nov 28 14:24:46 user nova-compute[75453]:   <features>
Nov 28 14:24:46 user nova-compute[75453]:     <acpi/>
Nov 28 14:24:46 user nova-compute[75453]:     <apic/>
Nov 28 14:24:46 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:24:46 user nova-compute[75453]:   </features>
Nov 28 14:24:46 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:24:46 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:24:46 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:24:46 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:24:46 user nova-compute[75453]:   </clock>
Nov 28 14:24:46 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:24:46 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:24:46 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:24:46 user nova-compute[75453]:   </cpu>
Nov 28 14:24:46 user nova-compute[75453]:   <devices>
Nov 28 14:24:46 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:24:46 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:24:46 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk"/>
Nov 28 14:24:46 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:24:46 user nova-compute[75453]:     </disk>
Nov 28 14:24:46 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:24:46 user nova-compute[75453]:       <mac address="fa:16:3e:6b:77:44"/>
Nov 28 14:24:46 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:24:46 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:24:46 user nova-compute[75453]:       <target dev="tap13b2b5c8-da"/>
Nov 28 14:24:46 user nova-compute[75453]:     </interface>
Nov 28 14:24:46 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:24:46 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/console.log" append="off"/>
Nov 28 14:24:46 user nova-compute[75453]:     </serial>
Nov 28 14:24:46 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:24:46 user nova-compute[75453]:     <video>
Nov 28 14:24:46 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:24:46 user nova-compute[75453]:     </video>
Nov 28 14:24:46 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:24:46 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:24:46 user nova-compute[75453]:     </rng>
Nov 28 14:24:46 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:24:46 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:24:46 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:24:46 user nova-compute[75453]:     </memballoon>
Nov 28 14:24:46 user nova-compute[75453]:   </devices>
Nov 28 14:24:46 user nova-compute[75453]: </domain>
Nov 28 14:24:46 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1897090922',display_name='tempest-ServerRescueNegativeTestJSON-server-1897090922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1897090922',id=41,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-0rftpo3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:24:45Z,user_data=None,user_id='7ac79717e12544d39215874f9b99ccf2',uuid=b1db2136-7fba-4701-bbc0-afee6b009a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:77:44,bridge_name='br-int',has_traffic_filtering=True,id=13b2b5c8-da0f-4c65-a267-199ae324844d,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b2b5c8-da') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG os_vif [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:77:44,bridge_name='br-int',has_traffic_filtering=True,id=13b2b5c8-da0f-4c65-a267-199ae324844d,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b2b5c8-da') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '957d22bf-6822-538d-b5be-0bf057309b50', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13b2b5c8-da, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13b2b5c8-da, col_values=(('qos', UUID('88333b8d-26ea-4ee2-8bd2-5c8e08e0cf65')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13b2b5c8-da, col_values=(('external_ids', {'iface-id': '13b2b5c8-da0f-4c65-a267-199ae324844d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:77:44', 'vm-uuid': 'b1db2136-7fba-4701-bbc0-afee6b009a3c'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:46 user nova-compute[75453]: INFO os_vif [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:77:44,bridge_name='br-int',has_traffic_filtering=True,id=13b2b5c8-da0f-4c65-a267-199ae324844d,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b2b5c8-da')
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No VIF found with MAC fa:16:3e:6b:77:44, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updated VIF entry in instance network info cache for port 13b2b5c8-da0f-4c65-a267-199ae324844d. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updating instance_info_cache with network_info: [{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:24:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f3937f74-51b8-41e5-a7d9-9cc4908aa7d6 req-5f8e80e7-8241-497a-9d25-59036ae0742a service nova] Releasing lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:24:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-changed-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:24:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Refreshing instance network info cache due to event network-changed-a5aaa001-eb54-42bf-b66f-537eafd16a55. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:24:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:24:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:24:47 user nova-compute[75453]: DEBUG nova.network.neutron [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Refreshing network info cache for port a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:24:48 user nova-compute[75453]: WARNING nova.compute.manager [req-78c92703-2577-449d-b516-1532ec816583 req-ef975b2d-00ba-4aac-ac6a-55bc20ac7330 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state building and task_state spawning.
Nov 28 14:24:48 user nova-compute[75453]: DEBUG nova.network.neutron [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updated VIF entry in instance network info cache for port a5aaa001-eb54-42bf-b66f-537eafd16a55. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG nova.network.neutron [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-eb36c34f-1b03-4cf2-90da-6a4ff8706ce2 req-a748d967-9262-4713-9f20-c255704dd123 service nova] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:24:48 user nova-compute[75453]: INFO nova.compute.manager [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] instance snapshotting
Nov 28 14:24:48 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Beginning live snapshot process
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json -f qcow2 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json -f qcow2 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0114rrax/829c350a4f7e43889a0aea6899ff4cbc.delta 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0114rrax/829c350a4f7e43889a0aea6899ff4cbc.delta 1073741824" returned: 0 in 0.057s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] No waiting events found dispatching network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:24:50 user nova-compute[75453]: WARNING nova.compute.manager [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received unexpected event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d for instance with vm_state building and task_state spawning.
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] No waiting events found dispatching network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:24:50 user nova-compute[75453]: WARNING nova.compute.manager [req-d414643f-823d-4c6c-a25d-5d90cf0ac496 req-3f5dec45-337e-4d8f-b4d9-8910faac54ea service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received unexpected event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d for instance with vm_state building and task_state spawning.
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:24:50 user nova-compute[75453]: WARNING nova.compute.manager [req-c92710c5-4f76-4c3f-930e-a1937b46d1a1 req-f0071368-8720-4093-bad4-b0bbd94d29a6 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state building and task_state spawning.
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 14:24:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0114rrax/829c350a4f7e43889a0aea6899ff4cbc.delta /opt/stack/data/nova/instances/snapshots/tmp0114rrax/829c350a4f7e43889a0aea6899ff4cbc {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:24:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Instance spawned successfully.
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:51 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance spawned successfully.
Nov 28 14:24:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:24:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:24:51 user nova-compute[75453]: INFO nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 28 14:24:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:24:51 user nova-compute[75453]: INFO nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Took 7.41 seconds to spawn the instance on the hypervisor.
Nov 28 14:24:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:24:51 user nova-compute[75453]: INFO nova.compute.manager [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Took 7.25 seconds to build instance.
Nov 28 14:24:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f05881c3-037b-4801-9458-79f944911133 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.355s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:51 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0114rrax/829c350a4f7e43889a0aea6899ff4cbc.delta /opt/stack/data/nova/instances/snapshots/tmp0114rrax/829c350a4f7e43889a0aea6899ff4cbc" returned: 0 in 0.501s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:24:51 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Snapshot extracted, beginning image upload
Nov 28 14:24:51 user nova-compute[75453]: INFO nova.compute.manager [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Took 8.10 seconds to build instance.
Nov 28 14:24:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4867f8eb-0506-4e54-9a38-02d47ad27fb1 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.203s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:24:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Snapshot image upload complete
Nov 28 14:24:54 user nova-compute[75453]: INFO nova.compute.manager [None req-bd386c61-c607-4fc4-87c5-94fb63c0ad0b tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Took 5.52 seconds to snapshot the instance on the hypervisor.
Nov 28 14:24:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:24:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:24 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:27 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:25:27 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:25:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:25:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:25:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:25:27 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:25:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:25:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:25:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:25:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:25:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:25:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:25:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:25:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:25:30 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:25:30 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:25:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=25.082233428955078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:25:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:25:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:25:32 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:25:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:25:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:25:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:25:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:25:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:25:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:25:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:25:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:25:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:26:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:26:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:26:26 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:27 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:26:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:26:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:26:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:28 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:30 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:26:30 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.081512451171875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:26:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:26:32 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:32 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:26:33 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:26:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:26:34 user nova-compute[75453]: INFO nova.compute.manager [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Rescuing
Nov 28 14:26:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquired lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updating instance_info_cache with network_info: [{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Releasing lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-unplugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] No waiting events found dispatching network-vif-unplugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:26:34 user nova-compute[75453]: WARNING nova.compute.manager [req-a965ce12-573d-495b-b39d-6096a463936b req-67b3db89-5ef8-4397-bf2d-e4cd6c63c71b service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received unexpected event network-vif-unplugged-13b2b5c8-da0f-4c65-a267-199ae324844d for instance with vm_state active and task_state rescuing.
Nov 28 14:26:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Instance destroyed successfully.
Nov 28 14:26:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Attempting rescue
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75453) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Instance directory exists: not creating {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 14:26:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Creating image(s)
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'trusted_certs' on Instance uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue" returned: 0 in 0.072s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'migration_context' on Instance uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.base [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<b1db2136-7fba-4701-bbc0-afee6b009a3c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Start _get_guest_xml network_info=[{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "vif_mac": "fa:16:3e:6b:77:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'resources' on Instance uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.base [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<b1db2136-7fba-4701-bbc0-afee6b009a3c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'numa_topology' on Instance uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.base [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<b1db2136-7fba-4701-bbc0-afee6b009a3c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:26:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'vcpu_model' on Instance uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.base [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<b1db2136-7fba-4701-bbc0-afee6b009a3c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1897090922',display_name='tempest-ServerRescueNegativeTestJSON-server-1897090922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1897090922',id=41,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-0rftpo3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:24:51Z,user_data=None,user_id='7ac79717e12544d39215874f9b99ccf2',uuid=b1db2136-7fba-4701-bbc0-afee6b009a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "vif_mac": "fa:16:3e:6b:77:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "vif_mac": "fa:16:3e:6b:77:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:77:44,bridge_name='br-int',has_traffic_filtering=True,id=13b2b5c8-da0f-4c65-a267-199ae324844d,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b2b5c8-da') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'pci_devices' on Instance uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.objects.base [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<b1db2136-7fba-4701-bbc0-afee6b009a3c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:26:35 user nova-compute[75453]:   <uuid>b1db2136-7fba-4701-bbc0-afee6b009a3c</uuid>
Nov 28 14:26:35 user nova-compute[75453]:   <name>instance-00000029</name>
Nov 28 14:26:35 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:26:35 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:26:35 user nova-compute[75453]:   <metadata>
Nov 28 14:26:35 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:26:35 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:26:35 user nova-compute[75453]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1897090922</nova:name>
Nov 28 14:26:35 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:26:35</nova:creationTime>
Nov 28 14:26:35 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:26:35 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:26:35 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:26:35 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:26:35 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:26:35 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:26:35 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:26:35 user nova-compute[75453]:       <nova:owner>
Nov 28 14:26:35 user nova-compute[75453]:         <nova:user uuid="7ac79717e12544d39215874f9b99ccf2">tempest-ServerRescueNegativeTestJSON-1690568266-project-member</nova:user>
Nov 28 14:26:35 user nova-compute[75453]:         <nova:project uuid="c90c4a02d30c48c7b6ee993b9b213c2b">tempest-ServerRescueNegativeTestJSON-1690568266</nova:project>
Nov 28 14:26:35 user nova-compute[75453]:       </nova:owner>
Nov 28 14:26:35 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:26:35 user nova-compute[75453]:       <nova:ports>
Nov 28 14:26:35 user nova-compute[75453]:         <nova:port uuid="13b2b5c8-da0f-4c65-a267-199ae324844d">
Nov 28 14:26:35 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 14:26:35 user nova-compute[75453]:         </nova:port>
Nov 28 14:26:35 user nova-compute[75453]:       </nova:ports>
Nov 28 14:26:35 user nova-compute[75453]:     </nova:instance>
Nov 28 14:26:35 user nova-compute[75453]:   </metadata>
Nov 28 14:26:35 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:26:35 user nova-compute[75453]:     <system>
Nov 28 14:26:35 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:26:35 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:26:35 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:26:35 user nova-compute[75453]:       <entry name="serial">b1db2136-7fba-4701-bbc0-afee6b009a3c</entry>
Nov 28 14:26:35 user nova-compute[75453]:       <entry name="uuid">b1db2136-7fba-4701-bbc0-afee6b009a3c</entry>
Nov 28 14:26:35 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:26:35 user nova-compute[75453]:     </system>
Nov 28 14:26:35 user nova-compute[75453]:   </sysinfo>
Nov 28 14:26:35 user nova-compute[75453]:   <os>
Nov 28 14:26:35 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:26:35 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:26:35 user nova-compute[75453]:   </os>
Nov 28 14:26:35 user nova-compute[75453]:   <features>
Nov 28 14:26:35 user nova-compute[75453]:     <acpi/>
Nov 28 14:26:35 user nova-compute[75453]:     <apic/>
Nov 28 14:26:35 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:26:35 user nova-compute[75453]:   </features>
Nov 28 14:26:35 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:26:35 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:26:35 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:26:35 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:26:35 user nova-compute[75453]:   </clock>
Nov 28 14:26:35 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:26:35 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:26:35 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:26:35 user nova-compute[75453]:   </cpu>
Nov 28 14:26:35 user nova-compute[75453]:   <devices>
Nov 28 14:26:35 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:26:35 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:26:35 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue"/>
Nov 28 14:26:35 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:26:35 user nova-compute[75453]:     </disk>
Nov 28 14:26:35 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:26:35 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:26:35 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk"/>
Nov 28 14:26:35 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 14:26:35 user nova-compute[75453]:     </disk>
Nov 28 14:26:35 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:26:35 user nova-compute[75453]:       <mac address="fa:16:3e:6b:77:44"/>
Nov 28 14:26:35 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:26:35 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:26:35 user nova-compute[75453]:       <target dev="tap13b2b5c8-da"/>
Nov 28 14:26:35 user nova-compute[75453]:     </interface>
Nov 28 14:26:35 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:26:35 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/console.log" append="off"/>
Nov 28 14:26:35 user nova-compute[75453]:     </serial>
Nov 28 14:26:35 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:26:35 user nova-compute[75453]:     <video>
Nov 28 14:26:35 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:26:35 user nova-compute[75453]:     </video>
Nov 28 14:26:35 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:26:35 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:26:35 user nova-compute[75453]:     </rng>
Nov 28 14:26:35 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:26:35 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:26:35 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:26:35 user nova-compute[75453]:     </memballoon>
Nov 28 14:26:35 user nova-compute[75453]:   </devices>
Nov 28 14:26:35 user nova-compute[75453]: </domain>
Nov 28 14:26:35 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:26:35 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Instance destroyed successfully.
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:26:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No VIF found with MAC fa:16:3e:6b:77:44, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:26:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:26:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] No waiting events found dispatching network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:26:36 user nova-compute[75453]: WARNING nova.compute.manager [req-7150ddab-0e40-47b6-bdc7-1b270b2cc492 req-e422a8b1-6cdd-4a25-aea1-43aaebcd58c4 service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received unexpected event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d for instance with vm_state active and task_state rescuing.
Nov 28 14:26:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] No waiting events found dispatching network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:26:38 user nova-compute[75453]: WARNING nova.compute.manager [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received unexpected event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d for instance with vm_state active and task_state rescuing.
Nov 28 14:26:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] No waiting events found dispatching network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:26:38 user nova-compute[75453]: WARNING nova.compute.manager [req-75608209-affc-4759-b928-f6209be096f9 req-4509b2f1-981d-4a11-a874-9f5ee451093b service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received unexpected event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d for instance with vm_state active and task_state rescuing.
Nov 28 14:26:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c8cad2c0-eccf-41ad-8bd3-fcf77a0e1169 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG nova.objects.instance [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'flavor' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:39 user nova-compute[75453]: INFO nova.compute.manager [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Attaching volume d44da527-b488-450c-8cb8-09a8e18c5bfb to /dev/vdb
Nov 28 14:26:39 user nova-compute[75453]: DEBUG os_brick.utils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[86087664-845a-49ef-a565-4a8a214fb6d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5043aa1-dcb0-401f-979c-21897f8bf59c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[991d98a8-2f10-4d8c-93d2-7b313cd1dd1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7af36d-2dd9-4c21-954e-606e5969d206]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:26:39 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:26:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4322a8c9-6441-4a32-a5ff-47737507a750]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG os_brick.utils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:26:39 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating existing volume attachment record: 9bfb4483-36f8-4996-99f2-4ea767a1dcaa {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:26:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:42 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:42 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:26:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:26:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSvRrcaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:26:49 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:26:49 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:26:49 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a099ac2-5574-4fb7-be30-d0fb899a73b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:26:49 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e95422b-97e3-4802-8083-d867cd98ffc2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb] added
Nov 28 14:26:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c836266d-9526-4e8d-8a23-cdb259f4e8c7]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[22daf996-38f8-48c4-8cd8-d5b0b1aea2f7]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSvRrcaJ {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSvRrcaJ" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3fd64c-a83e-485a-bc82-dc6d0cf6e254]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lSvRrcaJ'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd00277-33a0-4e93-8764-ef54090321ca]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e160ed1-2742-48bf-8cab-51cbc7969f73]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:26:49 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:26:49 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:26:49 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:26:49 user nova-compute[75453]: 
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6835c3f2-c7a7-412e-bdf3-3700c0627a89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb, portal: 172.16.0.220,3260]
Nov 28 14:26:49 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb, portal: 172.16.0.220,3260] successful.
Nov 28 14:26:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc6c284-1114-46f7-b9b2-ee69a810c6b4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b04b15-c9ed-4fb8-8e4a-6bf745e78d21]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb (non-flash)
Nov 28 14:26:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb (non-flash)
Nov 28 14:26:49 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513db4e-a733-497b-a571-9be72854fd9b]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:26:49 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSvRrcaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:26:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:26:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23466343932303631', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:26:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466343932303631', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:26:50 user nova-compute[75453]: DEBUG nova.objects.instance [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'flavor' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:26:50 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:26:50 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:26:50 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:26:50 user nova-compute[75453]:   <serial>d44da527-b488-450c-8cb8-09a8e18c5bfb</serial>
Nov 28 14:26:50 user nova-compute[75453]: </disk>
Nov 28 14:26:50 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] No VIF found with MAC fa:16:3e:cc:fb:5c, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8243ae70-2558-4b2d-9cb2-cd7fabf4c19e tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.542s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:26:51 user nova-compute[75453]: INFO nova.compute.manager [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Rescuing
Nov 28 14:26:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:26:51 user nova-compute[75453]: DEBUG nova.network.neutron [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG nova.network.neutron [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-unplugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-unplugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:26:52 user nova-compute[75453]: WARNING nova.compute.manager [req-642a9db4-c17d-4536-93bc-165ab7cbfc3c req-a1a0f6d9-c895-47be-bbc1-8d089aefaf82 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-unplugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state active and task_state rescuing.
Nov 28 14:26:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Instance destroyed successfully.
Nov 28 14:26:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Attempting a stable device rescue
Nov 28 14:26:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75453) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 14:26:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Instance directory exists: not creating {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 14:26:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Creating image(s)
Nov 28 14:26:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:53 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'trusted_certs' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG nova.virt.images [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] 49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8 was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd.part /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:26:54 user nova-compute[75453]: WARNING nova.compute.manager [req-a8998498-1c69-442f-bc7b-01089b083d9c req-fd7703b8-afea-44a8-aba6-f2c2842c8850 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state active and task_state rescuing.
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd.part /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd.converted" returned: 0 in 0.622s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.244s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd --force-share --output=json" returned: 0 in 0.167s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd,backing_fmt=raw /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd,backing_fmt=raw /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue" returned: 0 in 0.046s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'migration_context' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.objects.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Object Instance<eb3f8527-e81e-495a-8a3c-a7d8ee805b5c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Start _get_guest_xml network_info=[{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "vif_mac": "fa:16:3e:cc:fb:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '49dd9ecb-d6a4-4a5c-afa0-dc38d543d7f8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9bfb4483-36f8-4996-99f2-4ea767a1dcaa', 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSvRrcaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'eb3f8527-e81e-495a-8a3c-a7d8ee805b5c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd44da527-b488-450c-8cb8-09a8e18c5bfb', 'serial': 'd44da527-b488-450c-8cb8-09a8e18c5bfb'}, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'resources' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.objects.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Object Instance<eb3f8527-e81e-495a-8a3c-a7d8ee805b5c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'numa_topology' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.objects.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Object Instance<eb3f8527-e81e-495a-8a3c-a7d8ee805b5c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:55 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:26:55 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'vcpu_model' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.objects.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Object Instance<eb3f8527-e81e-495a-8a3c-a7d8ee805b5c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSvRrcaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:26:55 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:26:55 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:26:55 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a9bfea-cc2c-4d06-8f12-dc50b4331e0b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lSvRrcaJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 14:26:55 user nova-compute[75453]: node.name = iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb
Nov 28 14:26:55 user nova-compute[75453]: node.tpgt = -1
Nov 28 14:26:55 user nova-compute[75453]: node.startup = automatic
Nov 28 14:26:55 user nova-compute[75453]: node.leading_login = No
Nov 28 14:26:55 user nova-compute[75453]: iface.iscsi_ifacename = default
Nov 28 14:26:55 user nova-compute[75453]: iface.net_ifacename = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.ipaddress = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.prefix_len = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.hwaddress = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.transport_name = tcp
Nov 28 14:26:55 user nova-compute[75453]: iface.initiatorname = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.state = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.vlan_id = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.vlan_priority = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.vlan_state = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.iface_num = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.mtu = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.port = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.bootproto = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.subnet_mask = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.gateway = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.dhcp_alt_client_id = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.dhcp_dns = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.dhcp_learn_iqn = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.dhcp_vendor_id_state = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.dhcp_vendor_id = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.dhcp_slp_da = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.fragmentation = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.gratuitous_arp = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.incoming_forwarding = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.tos_state = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.tos = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.ttl = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.delayed_ack = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.tcp_nagle = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.tcp_wsf_state = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.tcp_wsf = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.tcp_timer_scale = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.tcp_timestamp = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.redirect = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.def_task_mgmt_timeout = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.header_digest = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.data_digest = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.immediate_data = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.initial_r2t = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.data_seq_inorder = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.data_pdu_inorder = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.erl = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.max_receive_data_len = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.first_burst_len = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.max_outstanding_r2t = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.max_burst_len = 0
Nov 28 14:26:55 user nova-compute[75453]: iface.chap_auth = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.bidi_chap = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.strict_login_compliance = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.discovery_auth = <empty>
Nov 28 14:26:55 user nova-compute[75453]: iface.discovery_logout = <empty>
Nov 28 14:26:55 user nova-compute[75453]: node.discovery_address = <empty>
Nov 28 14:26:55 user nova-compute[75453]: node.discovery_port = 0
Nov 28 14:26:55 user nova-compute[75453]: node.discovery_type = static
Nov 28 14:26:55 user nova-compute[75453]: node.session.initial_cmdsn = 0
Nov 28 14:26:55 user nova-compute[75453]: node.session.initial_login_retry_max = 8
Nov 28 14:26:55 user nova-compute[75453]: node.session.xmit_thread_priority = -20
Nov 28 14:26:55 user nova-compute[75453]: node.session.cmds_max = 128
Nov 28 14:26:55 user nova-compute[75453]: node.session.queue_depth = 32
Nov 28 14:26:55 user nova-compute[75453]: node.session.nr_sessions = 1
Nov 28 14:26:55 user nova-compute[75453]: node.session.auth.authmethod = CHAP
Nov 28 14:26:55 user nova-compute[75453]: node.session.auth.username = lSvRrcaJ
Nov 28 14:26:55 user nova-compute[75453]: node.session.auth.password = ***
Nov 28 14:26:55 user nova-compute[75453]: node.session.auth.username_in = <empty>
Nov 28 14:26:55 user nova-compute[75453]: node.session.auth.password_in = <empty>
Nov 28 14:26:55 user nova-compute[75453]: node.session.auth.chap_algs = MD5
Nov 28 14:26:55 user nova-compute[75453]: node.session.timeo.replacement_timeout = 120
Nov 28 14:26:55 user nova-compute[75453]: node.session.err_timeo.abort_timeout = 15
Nov 28 14:26:55 user nova-compute[75453]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 14:26:55 user nova-compute[75453]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 14:26:55 user nova-compute[75453]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.FastAbort = Yes
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.InitialR2T = No
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.ImmediateData = Yes
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.MaxConnections = 1
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 14:26:55 user nova-compute[75453]: node.session.iscsi.ERL = 0
Nov 28 14:26:55 user nova-compute[75453]: node.session.scan = manual
Nov 28 14:26:55 user nova-compute[75453]: node.session.reopen_max = 0
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].address = 172.16.0.220
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].port = 3260
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].startup = manual
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].tcp.window_size = 524288
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].tcp.type_of_service = 0
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].timeo.logout_timeout = 15
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].timeo.login_timeout = 15
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].timeo.auth_timeout = 45
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].iscsi.DataDigest = None
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].iscsi.IFMarker = No
Nov 28 14:26:55 user nova-compute[75453]: node.conn[0].iscsi.OFMarker = No
Nov 28 14:26:55 user nova-compute[75453]: # END RECORD
Nov 28 14:26:55 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[77303356-d75b-4708-8d91-ee0d8605f630]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07009c7-1ebf-421b-89ed-57933e9e4e0f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSvRrcaJ {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSvRrcaJ" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf952b76-e2e8-4d92-9cf3-5aaae6cb6b5e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lSvRrcaJ'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccad3e8-b3c9-4f3f-b453-3e1555cd39ed]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:26:55 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98409e4-542f-4821-9bac-232f90365dad]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb (non-flash)
Nov 28 14:26:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb (non-flash)
Nov 28 14:26:56 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] HCTL ('33', '0', '0', 0) found on session 47 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e7d601-d4f6-470d-839f-07ed6a118ae5]: (4, ('0 0 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Searching for a device in session 47 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSvRrcaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] <== connect_volume: return (167ms) {'type': 'block', 'scsi_wwn': '23466343932303631', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466343932303631', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1180311090',display_name='tempest-ServerStableDeviceRescueTest-server-1180311090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1180311090',id=39,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNvuS2G8T5YKELo2dJZ1hzfLKF7JYYyYTzxTnjYdok9t2F2vVjtP+g2P4mF9wy0UwkcFoeeu9dEjxztEjVxbCg0v5oALXWq66oanhAu2rY/frvgB0RqoDNfiiDQAQ1dTw==',key_name='tempest-keypair-1086921736',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba09555cf7f34e3fa050dec089a4da7a',ramdisk_id='',reservation_id='r-2qmhpi8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2057378686',owner_user_name='tempest-ServerStableDeviceRescueTest-2057378686-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7fff3e3f0754abc82c9d66c0fbf7527',uuid=eb3f8527-e81e-495a-8a3c-a7d8ee805b5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "vif_mac": "fa:16:3e:cc:fb:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Converting VIF {"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "vif_mac": "fa:16:3e:cc:fb:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fb:5c,bridge_name='br-int',has_traffic_filtering=True,id=a5aaa001-eb54-42bf-b66f-537eafd16a55,network=Network(5d207296-8c9c-436e-abd5-9a920c76f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aaa001-eb') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'pci_devices' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.objects.base [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Object Instance<eb3f8527-e81e-495a-8a3c-a7d8ee805b5c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:26:56 user nova-compute[75453]:   <uuid>eb3f8527-e81e-495a-8a3c-a7d8ee805b5c</uuid>
Nov 28 14:26:56 user nova-compute[75453]:   <name>instance-00000027</name>
Nov 28 14:26:56 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:26:56 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:26:56 user nova-compute[75453]:   <metadata>
Nov 28 14:26:56 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:26:56 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:26:56 user nova-compute[75453]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1180311090</nova:name>
Nov 28 14:26:56 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:26:55</nova:creationTime>
Nov 28 14:26:56 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:26:56 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:26:56 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:26:56 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:26:56 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:26:56 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:26:56 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:26:56 user nova-compute[75453]:       <nova:owner>
Nov 28 14:26:56 user nova-compute[75453]:         <nova:user uuid="c7fff3e3f0754abc82c9d66c0fbf7527">tempest-ServerStableDeviceRescueTest-2057378686-project-member</nova:user>
Nov 28 14:26:56 user nova-compute[75453]:         <nova:project uuid="ba09555cf7f34e3fa050dec089a4da7a">tempest-ServerStableDeviceRescueTest-2057378686</nova:project>
Nov 28 14:26:56 user nova-compute[75453]:       </nova:owner>
Nov 28 14:26:56 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:26:56 user nova-compute[75453]:       <nova:ports>
Nov 28 14:26:56 user nova-compute[75453]:         <nova:port uuid="a5aaa001-eb54-42bf-b66f-537eafd16a55">
Nov 28 14:26:56 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 14:26:56 user nova-compute[75453]:         </nova:port>
Nov 28 14:26:56 user nova-compute[75453]:       </nova:ports>
Nov 28 14:26:56 user nova-compute[75453]:     </nova:instance>
Nov 28 14:26:56 user nova-compute[75453]:   </metadata>
Nov 28 14:26:56 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:26:56 user nova-compute[75453]:     <system>
Nov 28 14:26:56 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:26:56 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:26:56 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:26:56 user nova-compute[75453]:       <entry name="serial">eb3f8527-e81e-495a-8a3c-a7d8ee805b5c</entry>
Nov 28 14:26:56 user nova-compute[75453]:       <entry name="uuid">eb3f8527-e81e-495a-8a3c-a7d8ee805b5c</entry>
Nov 28 14:26:56 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:26:56 user nova-compute[75453]:     </system>
Nov 28 14:26:56 user nova-compute[75453]:   </sysinfo>
Nov 28 14:26:56 user nova-compute[75453]:   <os>
Nov 28 14:26:56 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:26:56 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:26:56 user nova-compute[75453]:   </os>
Nov 28 14:26:56 user nova-compute[75453]:   <features>
Nov 28 14:26:56 user nova-compute[75453]:     <acpi/>
Nov 28 14:26:56 user nova-compute[75453]:     <apic/>
Nov 28 14:26:56 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:26:56 user nova-compute[75453]:   </features>
Nov 28 14:26:56 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:26:56 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:26:56 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:26:56 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:26:56 user nova-compute[75453]:   </clock>
Nov 28 14:26:56 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:26:56 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:26:56 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:26:56 user nova-compute[75453]:   </cpu>
Nov 28 14:26:56 user nova-compute[75453]:   <devices>
Nov 28 14:26:56 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:26:56 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:26:56 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk"/>
Nov 28 14:26:56 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:26:56 user nova-compute[75453]:     </disk>
Nov 28 14:26:56 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:26:56 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:26:56 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:26:56 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 14:26:56 user nova-compute[75453]:       <serial>d44da527-b488-450c-8cb8-09a8e18c5bfb</serial>
Nov 28 14:26:56 user nova-compute[75453]:     </disk>
Nov 28 14:26:56 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:26:56 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:26:56 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue"/>
Nov 28 14:26:56 user nova-compute[75453]:       <target dev="vdc" bus="virtio"/>
Nov 28 14:26:56 user nova-compute[75453]:       <boot order="1"/>
Nov 28 14:26:56 user nova-compute[75453]:     </disk>
Nov 28 14:26:56 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:26:56 user nova-compute[75453]:       <mac address="fa:16:3e:cc:fb:5c"/>
Nov 28 14:26:56 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:26:56 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:26:56 user nova-compute[75453]:       <target dev="tapa5aaa001-eb"/>
Nov 28 14:26:56 user nova-compute[75453]:     </interface>
Nov 28 14:26:56 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:26:56 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/console.log" append="off"/>
Nov 28 14:26:56 user nova-compute[75453]:     </serial>
Nov 28 14:26:56 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:26:56 user nova-compute[75453]:     <video>
Nov 28 14:26:56 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:26:56 user nova-compute[75453]:     </video>
Nov 28 14:26:56 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:26:56 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:26:56 user nova-compute[75453]:     </rng>
Nov 28 14:26:56 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:26:56 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:26:56 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:26:56 user nova-compute[75453]:     </memballoon>
Nov 28 14:26:56 user nova-compute[75453]:   </devices>
Nov 28 14:26:56 user nova-compute[75453]: </domain>
Nov 28 14:26:56 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:26:56 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Instance destroyed successfully.
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] No VIF found with MAC fa:16:3e:cc:fb:5c, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:26:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:26:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:26:57 user nova-compute[75453]: WARNING nova.compute.manager [req-3be4549a-51b4-4c7f-9ef1-807cecc2e93d req-4f8abbdb-e4cc-4ccf-a838-09f6596ec65d service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state active and task_state rescuing.
Nov 28 14:26:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:26:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:26:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:26:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:26:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:26:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:26:59 user nova-compute[75453]: WARNING nova.compute.manager [req-66180ba0-5eba-4fed-a0eb-e6d4bf01ef64 req-082ce017-a263-4f93-89c5-dce6d9681ca5 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state active and task_state rescuing.
Nov 28 14:27:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b1a4d2a2-1c8d-464c-b535-144a699136e9 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:27:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:21 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:25 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:27:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:27:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:27:29 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:27:29 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updating instance_info_cache with network_info: [{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:27:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:27:29 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:27:29 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:30 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:27:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:27:32 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:27:32 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:27:32 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=24.96786117553711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:27:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:27:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:27:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:27:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:27:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:27:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:27:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:27:33 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:27:33 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:27:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:27:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:27:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:27:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:27:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:27:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:27:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:28:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:28:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:28:26 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:28:29 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:28:30 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:28:30 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:28:30 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:28:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:28:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:28:30 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:28:30 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:28:31 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:32 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:28:33 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:28:33 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:28:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=24.967159271240234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:28:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:28:34 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:28:34 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:28:34 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:28:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:28:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:28:35 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:28:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:28:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:28:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:28:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:28:42 user nova-compute[75453]: INFO nova.compute.manager [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Unrescuing
Nov 28 14:28:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:28:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:28:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'flavor' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG nova.compute.manager [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-unplugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:28:43 user nova-compute[75453]: DEBUG nova.compute.manager [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-unplugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:28:43 user nova-compute[75453]: WARNING nova.compute.manager [req-e0c4a934-ac08-408a-aff2-96d618d2c9ae req-2015e996-a3d9-4aec-b3bc-92a14f01b60c service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-unplugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:28:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:44 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Instance destroyed successfully.
Nov 28 14:28:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:28:45 user nova-compute[75453]: WARNING nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:28:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-changed-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Refreshing instance network info cache due to event network-changed-a5aaa001-eb54-42bf-b66f-537eafd16a55. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Refreshing network info cache for port a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updated VIF entry in instance network info cache for port a5aaa001-eb54-42bf-b66f-537eafd16a55. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-changed-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Refreshing instance network info cache due to event network-changed-a5aaa001-eb54-42bf-b66f-537eafd16a55. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Acquiring lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Acquired lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Refreshing network info cache for port a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updated VIF entry in instance network info cache for port a5aaa001-eb54-42bf-b66f-537eafd16a55. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [{"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Releasing lock "refresh_cache-eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:28:46 user nova-compute[75453]: WARNING nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:28:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:28:46 user nova-compute[75453]: WARNING nova.compute.manager [req-24ef7ce7-85ba-4a05-97f2-befca2b3a48f req-edda3281-4ba7-4221-9869-1cfcd5aaf58b service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:28:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d52bb159-e766-4c7a-b607-b2715096a071 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:28:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:28:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:29:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:29:16 user nova-compute[75453]: INFO nova.compute.manager [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Detaching volume d44da527-b488-450c-8cb8-09a8e18c5bfb
Nov 28 14:29:16 user nova-compute[75453]: INFO nova.virt.block_device [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Attempting to driver detach volume d44da527-b488-450c-8cb8-09a8e18c5bfb from mountpoint /dev/vdb
Nov 28 14:29:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Attempting to detach device vdb from instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:29:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:29:16 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:29:16 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:29:16 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:29:16 user nova-compute[75453]:   <serial>d44da527-b488-450c-8cb8-09a8e18c5bfb</serial>
Nov 28 14:29:16 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:29:16 user nova-compute[75453]: </disk>
Nov 28 14:29:16 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:29:16 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Successfully detached device vdb from instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c from the persistent domain config.
Nov 28 14:29:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:29:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:29:16 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:29:16 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:29:16 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:29:16 user nova-compute[75453]:   <serial>d44da527-b488-450c-8cb8-09a8e18c5bfb</serial>
Nov 28 14:29:16 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:29:16 user nova-compute[75453]: </disk>
Nov 28 14:29:16 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:29:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:29:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:29:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:27 user nova-compute[75453]: INFO nova.compute.manager [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Rescuing
Nov 28 14:29:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:29:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquired lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:29:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Releasing lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:29:28 user nova-compute[75453]: WARNING nova.compute.manager [req-eac499bb-55fa-4c47-964e-37042d62164a req-343847a7-9217-40e0-bc30-f3249e627ff7 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state active and task_state rescuing.
Nov 28 14:29:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance destroyed successfully.
Nov 28 14:29:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Attempting rescue
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75453) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance directory exists: not creating {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 14:29:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Creating image(s)
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.023s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.instance [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'trusted_certs' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue" returned: 0 in 0.047s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.instance [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'migration_context' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.base [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<23f4cfb9-18d6-419b-9fb0-23a0da9da00f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Start _get_guest_xml network_info=[{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "vif_mac": "fa:16:3e:61:f4:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.instance [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'resources' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.base [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<23f4cfb9-18d6-419b-9fb0-23a0da9da00f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.instance [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'numa_topology' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.base [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<23f4cfb9-18d6-419b-9fb0-23a0da9da00f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:29:29 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:29:29 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.instance [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'vcpu_model' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.base [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<23f4cfb9-18d6-419b-9fb0-23a0da9da00f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1751051532',display_name='tempest-ServerRescueNegativeTestJSON-server-1751051532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1751051532',id=40,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-o8acmmwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:24:51Z,user_data=None,user_id='7ac79717e12544d39215874f9b99ccf2',uuid=23f4cfb9-18d6-419b-9fb0-23a0da9da00f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "vif_mac": "fa:16:3e:61:f4:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "vif_mac": "fa:16:3e:61:f4:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:f4:fe,bridge_name='br-int',has_traffic_filtering=True,id=3690b5db-09a7-4666-acc2-ef6d7d0ce3ed,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3690b5db-09') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.instance [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'pci_devices' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.objects.base [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<23f4cfb9-18d6-419b-9fb0-23a0da9da00f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:29:29 user nova-compute[75453]:   <uuid>23f4cfb9-18d6-419b-9fb0-23a0da9da00f</uuid>
Nov 28 14:29:29 user nova-compute[75453]:   <name>instance-00000028</name>
Nov 28 14:29:29 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:29:29 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:29:29 user nova-compute[75453]:   <metadata>
Nov 28 14:29:29 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:29:29 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:29:29 user nova-compute[75453]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1751051532</nova:name>
Nov 28 14:29:29 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:29:29</nova:creationTime>
Nov 28 14:29:29 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:29:29 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:29:29 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:29:29 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:29:29 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:29:29 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:29:29 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:29:29 user nova-compute[75453]:       <nova:owner>
Nov 28 14:29:29 user nova-compute[75453]:         <nova:user uuid="7ac79717e12544d39215874f9b99ccf2">tempest-ServerRescueNegativeTestJSON-1690568266-project-member</nova:user>
Nov 28 14:29:29 user nova-compute[75453]:         <nova:project uuid="c90c4a02d30c48c7b6ee993b9b213c2b">tempest-ServerRescueNegativeTestJSON-1690568266</nova:project>
Nov 28 14:29:29 user nova-compute[75453]:       </nova:owner>
Nov 28 14:29:29 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:29:29 user nova-compute[75453]:       <nova:ports>
Nov 28 14:29:29 user nova-compute[75453]:         <nova:port uuid="3690b5db-09a7-4666-acc2-ef6d7d0ce3ed">
Nov 28 14:29:29 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 14:29:29 user nova-compute[75453]:         </nova:port>
Nov 28 14:29:29 user nova-compute[75453]:       </nova:ports>
Nov 28 14:29:29 user nova-compute[75453]:     </nova:instance>
Nov 28 14:29:29 user nova-compute[75453]:   </metadata>
Nov 28 14:29:29 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:29:29 user nova-compute[75453]:     <system>
Nov 28 14:29:29 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:29:29 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:29:29 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:29:29 user nova-compute[75453]:       <entry name="serial">23f4cfb9-18d6-419b-9fb0-23a0da9da00f</entry>
Nov 28 14:29:29 user nova-compute[75453]:       <entry name="uuid">23f4cfb9-18d6-419b-9fb0-23a0da9da00f</entry>
Nov 28 14:29:29 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:29:29 user nova-compute[75453]:     </system>
Nov 28 14:29:29 user nova-compute[75453]:   </sysinfo>
Nov 28 14:29:29 user nova-compute[75453]:   <os>
Nov 28 14:29:29 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:29:29 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:29:29 user nova-compute[75453]:   </os>
Nov 28 14:29:29 user nova-compute[75453]:   <features>
Nov 28 14:29:29 user nova-compute[75453]:     <acpi/>
Nov 28 14:29:29 user nova-compute[75453]:     <apic/>
Nov 28 14:29:29 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:29:29 user nova-compute[75453]:   </features>
Nov 28 14:29:29 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:29:29 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:29:29 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:29:29 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:29:29 user nova-compute[75453]:   </clock>
Nov 28 14:29:29 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:29:29 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:29:29 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:29:29 user nova-compute[75453]:   </cpu>
Nov 28 14:29:29 user nova-compute[75453]:   <devices>
Nov 28 14:29:29 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:29:29 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:29:29 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue"/>
Nov 28 14:29:29 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:29:29 user nova-compute[75453]:     </disk>
Nov 28 14:29:29 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:29:29 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:29:29 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk"/>
Nov 28 14:29:29 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 14:29:29 user nova-compute[75453]:     </disk>
Nov 28 14:29:29 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:29:29 user nova-compute[75453]:       <mac address="fa:16:3e:61:f4:fe"/>
Nov 28 14:29:29 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:29:29 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:29:29 user nova-compute[75453]:       <target dev="tap3690b5db-09"/>
Nov 28 14:29:29 user nova-compute[75453]:     </interface>
Nov 28 14:29:29 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:29:29 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/console.log" append="off"/>
Nov 28 14:29:29 user nova-compute[75453]:     </serial>
Nov 28 14:29:29 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:29:29 user nova-compute[75453]:     <video>
Nov 28 14:29:29 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:29:29 user nova-compute[75453]:     </video>
Nov 28 14:29:29 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:29:29 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:29:29 user nova-compute[75453]:     </rng>
Nov 28 14:29:29 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:29:29 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:29:29 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:29:29 user nova-compute[75453]:     </memballoon>
Nov 28 14:29:29 user nova-compute[75453]:   </devices>
Nov 28 14:29:29 user nova-compute[75453]: </domain>
Nov 28 14:29:29 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:29:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance destroyed successfully.
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:29:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No VIF found with MAC fa:16:3e:61:f4:fe, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:29:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:29:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:29:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:29:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:29:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:29:30 user nova-compute[75453]: WARNING nova.compute.manager [req-8b983d86-288d-47a8-a733-2ac20d172726 req-02cca36c-ca6d-438c-babf-0392c7f08435 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state active and task_state rescuing.
Nov 28 14:29:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:29:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:29:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:29:31 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:29:32 user nova-compute[75453]: WARNING nova.compute.manager [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state active and task_state rescuing.
Nov 28 14:29:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:29:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:29:32 user nova-compute[75453]: WARNING nova.compute.manager [req-ebc1ccb5-00bf-46b7-a884-35b9fa3f6203 req-80f84606-b5bb-4b13-bb96-b24567b04b55 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state active and task_state rescuing.
Nov 28 14:29:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-61ae29d2-dd86-470f-bf0d-fdc796fd096c tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:29:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:29:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=24.965988159179688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:29:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:36 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c is timed out.
Nov 28 14:29:36 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Successfully detached device vdb from instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c from the live domain config.
Nov 28 14:29:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSvRrcaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:29:36 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0873bf98-4a34-4695-b12a-83f3b85c3448]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:29:36 user nova-compute[75453]: No targets found.
Nov 28 14:29:36 user nova-compute[75453]: iSNS:
Nov 28 14:29:36 user nova-compute[75453]: No targets found.
Nov 28 14:29:36 user nova-compute[75453]: STATIC:
Nov 28 14:29:36 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb
Nov 28 14:29:36 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:29:36 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:29:36 user nova-compute[75453]: FIRMWARE:
Nov 28 14:29:36 user nova-compute[75453]: No targets found.
Nov 28 14:29:36 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:29:36 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:29:36 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4eedef-b211-4f07-91f2-17b43de51a90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[03501b64-e8f9-4f2a-9cd0-cb015d2619a7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb (non-flash)
Nov 28 14:29:36 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb (non-flash)
Nov 28 14:29:36 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02186ebeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aa01b9-56a8-40c9-b282-3d0e07275c1c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b2d23-e065-4d59-9efd-a4e9e640b84c]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3209f949-7c75-4355-9cff-62480b5da7c9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:29:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26b1e42-eaf9-40e8-bf70-6b2450bc459c]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e74f534-087d-4014-aab1-ee8135ebbc8b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e895a28-c321-4e0f-ad11-2261fb1509e6]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb, portal: 172.16.0.220,3260]
Nov 28 14:29:37 user nova-compute[75453]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb, portal: 172.16.0.220,3260] successful.
Nov 28 14:29:37 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44da527-b488-450c-8cb8-09a8e18c5bfb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e1afa-13e2-4f3e-8c7e-8aaee0a60184]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] <== disconnect_volume: return (322ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'flavor' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:29:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f5ea3caa-2542-4738-aa3d-2da4e4d7f9c6 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.693s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:29:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:29:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:29:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:29:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:29:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:30:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:30:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:30:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:30:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:30:06 user nova-compute[75453]: INFO nova.compute.manager [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Terminating instance
Nov 28 14:30:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-unplugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-unplugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-00f72adb-2649-4524-9a3e-316a7a17ab60 req-62f9ae54-5acc-44f3-bc9d-ae44616efc12 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-unplugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:07 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Instance destroyed successfully.
Nov 28 14:30:07 user nova-compute[75453]: DEBUG nova.objects.instance [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lazy-loading 'resources' on Instance uuid eb3f8527-e81e-495a-8a3c-a7d8ee805b5c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1180311090',display_name='tempest-ServerStableDeviceRescueTest-server-1180311090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1180311090',id=39,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNvuS2G8T5YKELo2dJZ1hzfLKF7JYYyYTzxTnjYdok9t2F2vVjtP+g2P4mF9wy0UwkcFoeeu9dEjxztEjVxbCg0v5oALXWq66oanhAu2rY/frvgB0RqoDNfiiDQAQ1dTw==',key_name='tempest-keypair-1086921736',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:27:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba09555cf7f34e3fa050dec089a4da7a',ramdisk_id='',reservation_id='r-2qmhpi8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2057378686',owner_user_name='tempest-ServerStableDeviceRescueTest-2057378686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7fff3e3f0754abc82c9d66c0fbf7527',uuid=eb3f8527-e81e-495a-8a3c-a7d8ee805b5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Converting VIF {"id": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "address": "fa:16:3e:cc:fb:5c", "network": {"id": "5d207296-8c9c-436e-abd5-9a920c76f067", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-525404773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba09555cf7f34e3fa050dec089a4da7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aaa001-eb", "ovs_interfaceid": "a5aaa001-eb54-42bf-b66f-537eafd16a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fb:5c,bridge_name='br-int',has_traffic_filtering=True,id=a5aaa001-eb54-42bf-b66f-537eafd16a55,network=Network(5d207296-8c9c-436e-abd5-9a920c76f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aaa001-eb') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG os_vif [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fb:5c,bridge_name='br-int',has_traffic_filtering=True,id=a5aaa001-eb54-42bf-b66f-537eafd16a55,network=Network(5d207296-8c9c-436e-abd5-9a920c76f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aaa001-eb') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5aaa001-eb, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6f198f6-109d-4c3e-b1b9-b7762a3112cd) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:30:07 user nova-compute[75453]: INFO os_vif [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fb:5c,bridge_name='br-int',has_traffic_filtering=True,id=a5aaa001-eb54-42bf-b66f-537eafd16a55,network=Network(5d207296-8c9c-436e-abd5-9a920c76f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aaa001-eb')
Nov 28 14:30:07 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Deleting instance files /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c_del
Nov 28 14:30:07 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Deletion of /opt/stack/data/nova/instances/eb3f8527-e81e-495a-8a3c-a7d8ee805b5c_del complete
Nov 28 14:30:07 user nova-compute[75453]: INFO nova.compute.manager [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 14:30:07 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:30:07 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:30:08 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:30:08 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Took 0.69 seconds to deallocate network for instance.
Nov 28 14:30:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:30:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:30:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-90ac4018-e7b6-4b27-b7c0-79abee71020b req-cdda5e18-29af-4f82-9346-df5bcd69bc92 service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-deleted-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:30:08 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:30:08 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:30:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:30:08 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Deleted allocations for instance eb3f8527-e81e-495a-8a3c-a7d8ee805b5c
Nov 28 14:30:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bd2e3718-87ff-4de7-9d0f-44646ca93033 tempest-ServerStableDeviceRescueTest-2057378686 tempest-ServerStableDeviceRescueTest-2057378686-project-member] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.866s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:30:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:30:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] Acquiring lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:30:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:30:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] Lock "eb3f8527-e81e-495a-8a3c-a7d8ee805b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:30:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] No waiting events found dispatching network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:30:09 user nova-compute[75453]: WARNING nova.compute.manager [req-4e6aee1c-bcea-44a2-ae91-e5dfb029034c req-57f20e27-b6b7-4230-aa18-6bf76aab4d0e service nova] [instance: eb3f8527-e81e-495a-8a3c-a7d8ee805b5c] Received unexpected event network-vif-plugged-a5aaa001-eb54-42bf-b66f-537eafd16a55 for instance with vm_state deleted and task_state None.
Nov 28 14:30:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:30:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:30:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:30:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:30:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updating instance_info_cache with network_info: [{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:30:35 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:30:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.082656860351562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:30:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:30:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:30:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:30:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:30:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:30:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:30:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Verify base images {{(pid=75453) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Image id 0d03e2fc-4d16-4fd7-9616-933da07dcf7b yields fingerprint 38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d {{(pid=75453) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] image 0d03e2fc-4d16-4fd7-9616-933da07dcf7b at (/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d): checking
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] image 0d03e2fc-4d16-4fd7-9616-933da07dcf7b at (/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d): image is in use {{(pid=75453) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75453) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] b1db2136-7fba-4701-bbc0-afee6b009a3c is a valid instance name {{(pid=75453) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] b1db2136-7fba-4701-bbc0-afee6b009a3c has a disk file {{(pid=75453) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c is backed by 38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d {{(pid=75453) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] 23f4cfb9-18d6-419b-9fb0-23a0da9da00f is a valid instance name {{(pid=75453) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] 23f4cfb9-18d6-419b-9fb0-23a0da9da00f has a disk file {{(pid=75453) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f is backed by 38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d {{(pid=75453) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 14:30:57 user nova-compute[75453]: WARNING nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Unknown base file: /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed
Nov 28 14:30:57 user nova-compute[75453]: WARNING nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Unknown base file: /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478
Nov 28 14:30:57 user nova-compute[75453]: WARNING nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Unknown base file: /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd
Nov 28 14:30:57 user nova-compute[75453]: WARNING nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Unknown base file: /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3
Nov 28 14:30:57 user nova-compute[75453]: WARNING nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Unknown base file: /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71
Nov 28 14:30:57 user nova-compute[75453]: WARNING nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Unknown base file: /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5
Nov 28 14:30:57 user nova-compute[75453]: WARNING nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Unknown base file: /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2
Nov 28 14:30:57 user nova-compute[75453]: WARNING nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Unknown base file: /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Active base files: /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Removable base files: /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478 /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3 /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71 /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5 /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2 /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/637199ebd2cd2b247332ff7f0519c8ff3ae559ed
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/30ef75657ba578a2fdd9d77a3e8b3c5665468478
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f3d1e39ae245c10e7245bc3e3d5a4a6e12eaa6bd
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/33747d099d4a9fc707d67adeecd9b116444d0eb3
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/871f9a979040f0a7b889bc428222cc58c45dfd71
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/297f06fb495f2ecc25bb7ec765aacc06c78eb7a5
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7592661aac8b9cee9c0b21ecc40cd052731bd8b2
Nov 28 14:30:57 user nova-compute[75453]: INFO nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/529403a894f0a32ed9ee6c972cf38f6869b90ec7
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Verification complete {{(pid=75453) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Verify swap images {{(pid=75453) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 28 14:30:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.imagecache [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Verify ephemeral images {{(pid=75453) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 28 14:31:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:31:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:31:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:31:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:31:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:31:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:31:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:31:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:31:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:31:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:18 user nova-compute[75453]: INFO nova.compute.manager [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Unrescuing
Nov 28 14:31:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:31:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquired lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:31:18 user nova-compute[75453]: DEBUG nova.network.neutron [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG nova.network.neutron [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Releasing lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG nova.objects.instance [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'flavor' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:31:19 user nova-compute[75453]: WARNING nova.compute.manager [req-ec2f558a-b562-4d34-b34a-ad66dd19aac3 req-f8850e85-df43-49f6-b3c0-4c78ffaac441 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:31:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:19 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance destroyed successfully.
Nov 28 14:31:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:31:21 user nova-compute[75453]: WARNING nova.compute.manager [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:31:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:21 user nova-compute[75453]: DEBUG nova.compute.manager [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:31:21 user nova-compute[75453]: WARNING nova.compute.manager [req-d4f228fc-26da-45a3-8b7c-ce321fe792bb req-3870f1ed-2fc8-41fc-bd1b-92f0b5e65245 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:31:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:23 user nova-compute[75453]: DEBUG nova.compute.manager [None req-02709a12-51c1-4246-92b5-4e07a1645e73 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:31:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:31:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:23 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:23 user nova-compute[75453]: DEBUG nova.compute.manager [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:31:23 user nova-compute[75453]: WARNING nova.compute.manager [req-dfe9e2ee-619a-43a6-83d4-0971762e935d req-83fbcd3f-56c3-465c-acd0-5f57e4064da6 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state active and task_state None.
Nov 28 14:31:24 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:31:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:33 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:31:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:31:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:31:34 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:34 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:31:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:36 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:31:36 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=25.080398559570312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:31:36 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:31:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:39 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:39 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:39 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:31:42 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:31:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:31:48 user nova-compute[75453]: INFO nova.compute.claims [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Claim successful on node user
Nov 28 14:31:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:31:48 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.policy [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:31:48 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Creating image(s)
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "/opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "/opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk 1073741824" returned: 0 in 0.057s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Cannot resize image /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Ensure instance console log exists: /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:49 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Successfully created port: 03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Successfully updated port: 03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquired lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-changed-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Refreshing instance network info cache due to event network-changed-03247349-1758-4904-ae30-79ca21ccdd7c. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] Acquiring lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updating instance_info_cache with network_info: [{"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Releasing lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Instance network_info: |[{"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] Acquired lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.network.neutron [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Refreshing network info cache for port 03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Start _get_guest_xml network_info=[{"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:31:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:31:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-102692577',display_name='tempest-TestStampPattern-server-102692577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-102692577',id=42,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlACDPTL6lOcjqqSooAi6giBxkW7z8+nvDYlDd3hrEjP688kTjSCtRF1nVxeSXC0yyn/ol13aOaO+aT10A+GYRLWLEQzkyhrTQ//E/rJe7JWWH0vtmRcTySspOPrQW4Q==',key_name='tempest-TestStampPattern-840267874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a532227da343209095aca11e672e87',ramdisk_id='',reservation_id='r-yjsfr5c2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-352626173',owner_user_name='tempest-TestStampPattern-352626173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:31:49Z,user_data=None,user_id='2b16a7dabefd4644b463e1a45a0b40dd',uuid=7c3306d3-7632-4369-bdf9-8ace904a05fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converting VIF {"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:79:1c,bridge_name='br-int',has_traffic_filtering=True,id=03247349-1758-4904-ae30-79ca21ccdd7c,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247349-17') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.objects.instance [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c3306d3-7632-4369-bdf9-8ace904a05fd {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:31:50 user nova-compute[75453]:   <uuid>7c3306d3-7632-4369-bdf9-8ace904a05fd</uuid>
Nov 28 14:31:50 user nova-compute[75453]:   <name>instance-0000002a</name>
Nov 28 14:31:50 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:31:50 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:31:50 user nova-compute[75453]:   <metadata>
Nov 28 14:31:50 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:31:50 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:31:50 user nova-compute[75453]:       <nova:name>tempest-TestStampPattern-server-102692577</nova:name>
Nov 28 14:31:50 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:31:50</nova:creationTime>
Nov 28 14:31:50 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:31:50 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:31:50 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:31:50 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:31:50 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:31:50 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:31:50 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:31:50 user nova-compute[75453]:       <nova:owner>
Nov 28 14:31:50 user nova-compute[75453]:         <nova:user uuid="2b16a7dabefd4644b463e1a45a0b40dd">tempest-TestStampPattern-352626173-project-member</nova:user>
Nov 28 14:31:50 user nova-compute[75453]:         <nova:project uuid="a7a532227da343209095aca11e672e87">tempest-TestStampPattern-352626173</nova:project>
Nov 28 14:31:50 user nova-compute[75453]:       </nova:owner>
Nov 28 14:31:50 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:31:50 user nova-compute[75453]:       <nova:ports>
Nov 28 14:31:50 user nova-compute[75453]:         <nova:port uuid="03247349-1758-4904-ae30-79ca21ccdd7c">
Nov 28 14:31:50 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 14:31:50 user nova-compute[75453]:         </nova:port>
Nov 28 14:31:50 user nova-compute[75453]:       </nova:ports>
Nov 28 14:31:50 user nova-compute[75453]:     </nova:instance>
Nov 28 14:31:50 user nova-compute[75453]:   </metadata>
Nov 28 14:31:50 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:31:50 user nova-compute[75453]:     <system>
Nov 28 14:31:50 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:31:50 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:31:50 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:31:50 user nova-compute[75453]:       <entry name="serial">7c3306d3-7632-4369-bdf9-8ace904a05fd</entry>
Nov 28 14:31:50 user nova-compute[75453]:       <entry name="uuid">7c3306d3-7632-4369-bdf9-8ace904a05fd</entry>
Nov 28 14:31:50 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:31:50 user nova-compute[75453]:     </system>
Nov 28 14:31:50 user nova-compute[75453]:   </sysinfo>
Nov 28 14:31:50 user nova-compute[75453]:   <os>
Nov 28 14:31:50 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:31:50 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:31:50 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:31:50 user nova-compute[75453]:   </os>
Nov 28 14:31:50 user nova-compute[75453]:   <features>
Nov 28 14:31:50 user nova-compute[75453]:     <acpi/>
Nov 28 14:31:50 user nova-compute[75453]:     <apic/>
Nov 28 14:31:50 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:31:50 user nova-compute[75453]:   </features>
Nov 28 14:31:50 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:31:50 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:31:50 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:31:50 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:31:50 user nova-compute[75453]:   </clock>
Nov 28 14:31:50 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:31:50 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:31:50 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:31:50 user nova-compute[75453]:   </cpu>
Nov 28 14:31:50 user nova-compute[75453]:   <devices>
Nov 28 14:31:50 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:31:50 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:31:50 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk"/>
Nov 28 14:31:50 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:31:50 user nova-compute[75453]:     </disk>
Nov 28 14:31:50 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:31:50 user nova-compute[75453]:       <mac address="fa:16:3e:8e:79:1c"/>
Nov 28 14:31:50 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:31:50 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:31:50 user nova-compute[75453]:       <target dev="tap03247349-17"/>
Nov 28 14:31:50 user nova-compute[75453]:     </interface>
Nov 28 14:31:50 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:31:50 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/console.log" append="off"/>
Nov 28 14:31:50 user nova-compute[75453]:     </serial>
Nov 28 14:31:50 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:31:50 user nova-compute[75453]:     <video>
Nov 28 14:31:50 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:31:50 user nova-compute[75453]:     </video>
Nov 28 14:31:50 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:31:50 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:31:50 user nova-compute[75453]:     </rng>
Nov 28 14:31:50 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:31:50 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:31:50 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:31:50 user nova-compute[75453]:     </memballoon>
Nov 28 14:31:50 user nova-compute[75453]:   </devices>
Nov 28 14:31:50 user nova-compute[75453]: </domain>
Nov 28 14:31:50 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-102692577',display_name='tempest-TestStampPattern-server-102692577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-102692577',id=42,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlACDPTL6lOcjqqSooAi6giBxkW7z8+nvDYlDd3hrEjP688kTjSCtRF1nVxeSXC0yyn/ol13aOaO+aT10A+GYRLWLEQzkyhrTQ//E/rJe7JWWH0vtmRcTySspOPrQW4Q==',key_name='tempest-TestStampPattern-840267874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a532227da343209095aca11e672e87',ramdisk_id='',reservation_id='r-yjsfr5c2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-352626173',owner_user_name='tempest-TestStampPattern-352626173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:31:49Z,user_data=None,user_id='2b16a7dabefd4644b463e1a45a0b40dd',uuid=7c3306d3-7632-4369-bdf9-8ace904a05fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converting VIF {"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:79:1c,bridge_name='br-int',has_traffic_filtering=True,id=03247349-1758-4904-ae30-79ca21ccdd7c,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247349-17') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG os_vif [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:79:1c,bridge_name='br-int',has_traffic_filtering=True,id=03247349-1758-4904-ae30-79ca21ccdd7c,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247349-17') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37c69113-6299-53a0-a60d-8da88acccd7f', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03247349-17, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03247349-17, col_values=(('qos', UUID('3755ea7a-bacd-49ca-bd30-dbf1bf86e592')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03247349-17, col_values=(('external_ids', {'iface-id': '03247349-1758-4904-ae30-79ca21ccdd7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:79:1c', 'vm-uuid': '7c3306d3-7632-4369-bdf9-8ace904a05fd'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:50 user nova-compute[75453]: INFO os_vif [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:79:1c,bridge_name='br-int',has_traffic_filtering=True,id=03247349-1758-4904-ae30-79ca21ccdd7c,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247349-17')
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:31:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No VIF found with MAC fa:16:3e:8e:79:1c, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:31:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updated VIF entry in instance network info cache for port 03247349-1758-4904-ae30-79ca21ccdd7c. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:31:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updating instance_info_cache with network_info: [{"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:31:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d4d74c47-cc3c-4d7e-b133-b1e9f8f59a00 req-78926f1d-5da0-4b5d-bffa-c515bd4b310d service nova] Releasing lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] No waiting events found dispatching network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:31:52 user nova-compute[75453]: WARNING nova.compute.manager [req-69b0f938-0157-4e3e-9c3a-4a5eedfc11c0 req-2c580d56-925b-4ec3-b524-6c527a1ca10e service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received unexpected event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c for instance with vm_state building and task_state spawning.
Nov 28 14:31:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:31:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Instance spawned successfully.
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] No waiting events found dispatching network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:31:54 user nova-compute[75453]: WARNING nova.compute.manager [req-bd4d2af1-b752-4fe2-b46c-5ba63df79249 req-4cb26393-7c4d-40bd-b50e-ae383ec8feb6 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received unexpected event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c for instance with vm_state building and task_state spawning.
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:31:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:31:54 user nova-compute[75453]: INFO nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 28 14:31:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:31:54 user nova-compute[75453]: INFO nova.compute.manager [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Took 6.38 seconds to build instance.
Nov 28 14:31:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-5c759004-2a02-428a-989c-7529e6d8c0fc tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.494s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:31:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:31:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_power_states {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 7c3306d3-7632-4369-bdf9-8ace904a05fd {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:32:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:32:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:32:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:32:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:32:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:32:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:26 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:34 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:32:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:32:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:32:34 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:32:34 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updating instance_info_cache with network_info: [{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:32:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:32:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:32:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:32:37 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:32:37 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:32:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.04977798461914GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:32:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:32:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:32:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:32:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:32:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:32:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:32:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:32:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:32:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:33:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:33:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:33:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:33:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:33:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:33:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:33:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:33:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:33:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:33:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:33:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:33:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:33:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:33:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:33:14 user nova-compute[75453]: INFO nova.compute.claims [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Claim successful on node user
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.network.neutron [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:33:14 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.policy [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ac79717e12544d39215874f9b99ccf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90c4a02d30c48c7b6ee993b9b213c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:33:14 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Creating image(s)
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:14 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk 1073741824" returned: 0 in 0.052s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Successfully created port: 9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Cannot resize image /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Ensure instance console log exists: /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Successfully updated port: 9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquired lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-changed-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Refreshing instance network info cache due to event network-changed-9b815f80-08ff-4406-840c-b2152652eea6. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] Acquiring lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Releasing lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Instance network_info: |[{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] Acquired lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.neutron [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Refreshing network info cache for port 9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Start _get_guest_xml network_info=[{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:33:16 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:33:16 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2143021861',display_name='tempest-ServerRescueNegativeTestJSON-server-2143021861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2143021861',id=43,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0y2cqY3F/6K6W4DPXhIl7hrZlCa2hSi8sETskoLDchgOrSOVppHWCOUoYleJrOOHP3WBIK8O/1fXEaJPGh0AUIhsm1RDrjptysW476kRslDpBjaJqcktMwW7JzfrzV5A==',key_name='tempest-keypair-1935967308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-vuiayuhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:33:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ac79717e12544d39215874f9b99ccf2',uuid=e1c46e9d-f04c-4e5f-975e-cf191849d243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:cc:ed,bridge_name='br-int',has_traffic_filtering=True,id=9b815f80-08ff-4406-840c-b2152652eea6,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b815f80-08') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.objects.instance [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'pci_devices' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:33:16 user nova-compute[75453]:   <uuid>e1c46e9d-f04c-4e5f-975e-cf191849d243</uuid>
Nov 28 14:33:16 user nova-compute[75453]:   <name>instance-0000002b</name>
Nov 28 14:33:16 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:33:16 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:33:16 user nova-compute[75453]:   <metadata>
Nov 28 14:33:16 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:33:16 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:33:16 user nova-compute[75453]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2143021861</nova:name>
Nov 28 14:33:16 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:33:16</nova:creationTime>
Nov 28 14:33:16 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:33:16 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:33:16 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:33:16 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:33:16 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:33:16 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:33:16 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:33:16 user nova-compute[75453]:       <nova:owner>
Nov 28 14:33:16 user nova-compute[75453]:         <nova:user uuid="7ac79717e12544d39215874f9b99ccf2">tempest-ServerRescueNegativeTestJSON-1690568266-project-member</nova:user>
Nov 28 14:33:16 user nova-compute[75453]:         <nova:project uuid="c90c4a02d30c48c7b6ee993b9b213c2b">tempest-ServerRescueNegativeTestJSON-1690568266</nova:project>
Nov 28 14:33:16 user nova-compute[75453]:       </nova:owner>
Nov 28 14:33:16 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:33:16 user nova-compute[75453]:       <nova:ports>
Nov 28 14:33:16 user nova-compute[75453]:         <nova:port uuid="9b815f80-08ff-4406-840c-b2152652eea6">
Nov 28 14:33:16 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 14:33:16 user nova-compute[75453]:         </nova:port>
Nov 28 14:33:16 user nova-compute[75453]:       </nova:ports>
Nov 28 14:33:16 user nova-compute[75453]:     </nova:instance>
Nov 28 14:33:16 user nova-compute[75453]:   </metadata>
Nov 28 14:33:16 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:33:16 user nova-compute[75453]:     <system>
Nov 28 14:33:16 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:33:16 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:33:16 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:33:16 user nova-compute[75453]:       <entry name="serial">e1c46e9d-f04c-4e5f-975e-cf191849d243</entry>
Nov 28 14:33:16 user nova-compute[75453]:       <entry name="uuid">e1c46e9d-f04c-4e5f-975e-cf191849d243</entry>
Nov 28 14:33:16 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:33:16 user nova-compute[75453]:     </system>
Nov 28 14:33:16 user nova-compute[75453]:   </sysinfo>
Nov 28 14:33:16 user nova-compute[75453]:   <os>
Nov 28 14:33:16 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:33:16 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:33:16 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:33:16 user nova-compute[75453]:   </os>
Nov 28 14:33:16 user nova-compute[75453]:   <features>
Nov 28 14:33:16 user nova-compute[75453]:     <acpi/>
Nov 28 14:33:16 user nova-compute[75453]:     <apic/>
Nov 28 14:33:16 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:33:16 user nova-compute[75453]:   </features>
Nov 28 14:33:16 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:33:16 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:33:16 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:33:16 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:33:16 user nova-compute[75453]:   </clock>
Nov 28 14:33:16 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:33:16 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:33:16 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:33:16 user nova-compute[75453]:   </cpu>
Nov 28 14:33:16 user nova-compute[75453]:   <devices>
Nov 28 14:33:16 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:33:16 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:33:16 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk"/>
Nov 28 14:33:16 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:33:16 user nova-compute[75453]:     </disk>
Nov 28 14:33:16 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:33:16 user nova-compute[75453]:       <mac address="fa:16:3e:12:cc:ed"/>
Nov 28 14:33:16 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:33:16 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:33:16 user nova-compute[75453]:       <target dev="tap9b815f80-08"/>
Nov 28 14:33:16 user nova-compute[75453]:     </interface>
Nov 28 14:33:16 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:33:16 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/console.log" append="off"/>
Nov 28 14:33:16 user nova-compute[75453]:     </serial>
Nov 28 14:33:16 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:33:16 user nova-compute[75453]:     <video>
Nov 28 14:33:16 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:33:16 user nova-compute[75453]:     </video>
Nov 28 14:33:16 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:33:16 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:33:16 user nova-compute[75453]:     </rng>
Nov 28 14:33:16 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:33:16 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:33:16 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:33:16 user nova-compute[75453]:     </memballoon>
Nov 28 14:33:16 user nova-compute[75453]:   </devices>
Nov 28 14:33:16 user nova-compute[75453]: </domain>
Nov 28 14:33:16 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2143021861',display_name='tempest-ServerRescueNegativeTestJSON-server-2143021861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2143021861',id=43,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0y2cqY3F/6K6W4DPXhIl7hrZlCa2hSi8sETskoLDchgOrSOVppHWCOUoYleJrOOHP3WBIK8O/1fXEaJPGh0AUIhsm1RDrjptysW476kRslDpBjaJqcktMwW7JzfrzV5A==',key_name='tempest-keypair-1935967308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-vuiayuhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:33:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ac79717e12544d39215874f9b99ccf2',uuid=e1c46e9d-f04c-4e5f-975e-cf191849d243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:cc:ed,bridge_name='br-int',has_traffic_filtering=True,id=9b815f80-08ff-4406-840c-b2152652eea6,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b815f80-08') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG os_vif [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:cc:ed,bridge_name='br-int',has_traffic_filtering=True,id=9b815f80-08ff-4406-840c-b2152652eea6,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b815f80-08') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52abcd25-9a85-5821-9a25-74885283fe82', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b815f80-08, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b815f80-08, col_values=(('qos', UUID('a3dd0f93-7126-4f80-8603-3e353ab1cca1')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b815f80-08, col_values=(('external_ids', {'iface-id': '9b815f80-08ff-4406-840c-b2152652eea6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:cc:ed', 'vm-uuid': 'e1c46e9d-f04c-4e5f-975e-cf191849d243'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:16 user nova-compute[75453]: INFO os_vif [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:cc:ed,bridge_name='br-int',has_traffic_filtering=True,id=9b815f80-08ff-4406-840c-b2152652eea6,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b815f80-08')
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No VIF found with MAC fa:16:3e:12:cc:ed, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.neutron [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updated VIF entry in instance network info cache for port 9b815f80-08ff-4406-840c-b2152652eea6. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG nova.network.neutron [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:33:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e7919e3f-f4ce-4c32-9396-3ca5ddd32a52 req-0f03ec89-2d97-4724-90f9-97b2aa3d5bff service nova] Releasing lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:33:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:33:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:33:18 user nova-compute[75453]: WARNING nova.compute.manager [req-5cad44e3-c5a7-4347-9c7b-696da2aa5179 req-91176b49-cd71-402e-ba94-83786a5bb97c service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state building and task_state spawning.
Nov 28 14:33:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:33:20 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Instance spawned successfully.
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:33:20 user nova-compute[75453]: INFO nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:33:20 user nova-compute[75453]: WARNING nova.compute.manager [req-841a734f-f727-49fd-af22-27a18cef0ee5 req-bb9934e5-1b71-4150-8169-87d68405c3f3 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state building and task_state spawning.
Nov 28 14:33:20 user nova-compute[75453]: INFO nova.compute.manager [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Took 6.00 seconds to build instance.
Nov 28 14:33:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-83ceb269-0c63-400b-a7a6-929ed7fd2709 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.102s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:26 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:33:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:30 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:33:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:33:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:33 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:33:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:33:35 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:33:35 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:33:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:33:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:33:35 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:33:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:38 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:33:38 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8613MB free_disk=25.02184295654297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e1c46e9d-f04c-4e5f-975e-cf191849d243 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:33:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-changed-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:33:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Refreshing instance network info cache due to event network-changed-03247349-1758-4904-ae30-79ca21ccdd7c. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:33:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] Acquiring lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:33:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] Acquired lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:33:39 user nova-compute[75453]: DEBUG nova.network.neutron [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Refreshing network info cache for port 03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updated VIF entry in instance network info cache for port 03247349-1758-4904-ae30-79ca21ccdd7c. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG nova.network.neutron [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updating instance_info_cache with network_info: [{"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6226a189-6cfe-4a4d-a1b8-63a0adbc1474 req-ae87aace-4ff8-4378-b4a4-c2121f950575 service nova] Releasing lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG nova.objects.instance [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'flavor' on Instance uuid 7c3306d3-7632-4369-bdf9-8ace904a05fd {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:40 user nova-compute[75453]: INFO nova.compute.manager [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Attaching volume 4318c6ce-732f-4f02-893f-ce91107dfe30 to /dev/vdb
Nov 28 14:33:40 user nova-compute[75453]: DEBUG os_brick.utils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[236a83bf-a2d0-4556-b54b-6fe077ac402e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2485cf0e-8869-410f-8b50-db9c9d45af4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3c4691-583a-449f-a974-7f6c94badaef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b7a2a9-3401-4151-9cee-17d9c88f8a74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:33:40 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:33:40 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff92c750-2568-410a-895e-d53ac68f5ecc]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG os_brick.utils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:33:40 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updating existing volume attachment record: fb4f69a6-91a8-4e33-8025-3fec93495d6d {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:33:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:33:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:33:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:33:41 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:33:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:33:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTfzhrkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:33:47 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:33:47 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:33:47 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca6113c-ef5a-413f-8250-d5fe3a457f20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:33:47 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f667475a-cde8-443c-b18d-cd3b78fa4910]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30] added
Nov 28 14:33:47 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb70fb7-2246-469e-8d71-1bc0372c98dd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df890b4-6f77-4a10-ba8f-5de3152a763a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTfzhrkl {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTfzhrkl" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3395b7-9fb1-4520-9d7b-2fb85231310b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MTfzhrkl'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef726e-8b2d-4708-b705-61a2be84130e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4435a158-d674-4b34-baee-422448f3a4dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:33:47 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:33:47 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:33:47 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:33:47 user nova-compute[75453]: 
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d697e6-4a42-49c3-a79a-505f27fff5df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30, portal: 172.16.0.220,3260]
Nov 28 14:33:47 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30, portal: 172.16.0.220,3260] successful.
Nov 28 14:33:47 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2420b210-6d62-460f-b1e7-f8d275de12f2]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ad660-8dcd-40cd-a11d-33b86684bb65]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 (non-flash)
Nov 28 14:33:47 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 (non-flash)
Nov 28 14:33:47 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[99447622-b7a4-4968-bf41-c8a0816d367f]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:33:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTfzhrkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:33:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:33:48 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23733626163323337', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:33:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733626163323337', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:33:48 user nova-compute[75453]: DEBUG nova.objects.instance [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'flavor' on Instance uuid 7c3306d3-7632-4369-bdf9-8ace904a05fd {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:33:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:33:48 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:33:48 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:33:48 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:33:48 user nova-compute[75453]:   <serial>4318c6ce-732f-4f02-893f-ce91107dfe30</serial>
Nov 28 14:33:48 user nova-compute[75453]: </disk>
Nov 28 14:33:48 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:33:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:33:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:33:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No VIF found with MAC fa:16:3e:8e:79:1c, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:33:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-29ac777f-ec79-46ad-bc33-812510118474 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.793s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:33:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:33:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:33:51 user nova-compute[75453]: INFO nova.compute.manager [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Detaching volume 4318c6ce-732f-4f02-893f-ce91107dfe30
Nov 28 14:33:52 user nova-compute[75453]: INFO nova.virt.block_device [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Attempting to driver detach volume 4318c6ce-732f-4f02-893f-ce91107dfe30 from mountpoint /dev/vdb
Nov 28 14:33:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Attempting to detach device vdb from instance 7c3306d3-7632-4369-bdf9-8ace904a05fd from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:33:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:33:52 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:33:52 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:33:52 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:33:52 user nova-compute[75453]:   <serial>4318c6ce-732f-4f02-893f-ce91107dfe30</serial>
Nov 28 14:33:52 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:33:52 user nova-compute[75453]: </disk>
Nov 28 14:33:52 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:33:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Successfully detached device vdb from instance 7c3306d3-7632-4369-bdf9-8ace904a05fd from the persistent domain config.
Nov 28 14:33:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c3306d3-7632-4369-bdf9-8ace904a05fd from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:33:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:33:52 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:33:52 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:33:52 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:33:52 user nova-compute[75453]:   <serial>4318c6ce-732f-4f02-893f-ce91107dfe30</serial>
Nov 28 14:33:52 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:33:52 user nova-compute[75453]: </disk>
Nov 28 14:33:52 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:33:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:33:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:33:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:12 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7c3306d3-7632-4369-bdf9-8ace904a05fd is timed out.
Nov 28 14:34:12 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Successfully detached device vdb from instance 7c3306d3-7632-4369-bdf9-8ace904a05fd from the live domain config.
Nov 28 14:34:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTfzhrkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:34:12 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83138c5-ac02-4dc4-b75d-a5b5797da6e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:34:12 user nova-compute[75453]: No targets found.
Nov 28 14:34:12 user nova-compute[75453]: iSNS:
Nov 28 14:34:12 user nova-compute[75453]: No targets found.
Nov 28 14:34:12 user nova-compute[75453]: STATIC:
Nov 28 14:34:12 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30
Nov 28 14:34:12 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:34:12 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:34:12 user nova-compute[75453]: FIRMWARE:
Nov 28 14:34:12 user nova-compute[75453]: No targets found.
Nov 28 14:34:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:34:12 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:34:12 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2d363b-dd8c-48be-a4d3-3a32e8949f0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52973fa-718e-4ca9-a061-9620fb695221]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 (non-flash)
Nov 28 14:34:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 (non-flash)
Nov 28 14:34:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c6b4f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c80115-3305-4294-8505-7eeea9a64dfc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf716b34-e0f4-43c1-af3f-04d902302e7d]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[134f7fcd-b44d-4363-ad26-318b8d662e16]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef807da-e95a-454a-8ad5-039a5a1404f7]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[921fef0d-c5bb-4330-9128-e159e5ab9068]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e36244b-d5fd-4429-9d36-20a67d80d0f5]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30, portal: 172.16.0.220,3260]
Nov 28 14:34:12 user nova-compute[75453]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30, portal: 172.16.0.220,3260] successful.
Nov 28 14:34:12 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4318c6ce-732f-4f02-893f-ce91107dfe30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f41d56-a81c-46be-b52a-7ac24edc6345]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] <== disconnect_volume: return (266ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:34:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:34:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:13 user nova-compute[75453]: DEBUG nova.objects.instance [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'flavor' on Instance uuid 7c3306d3-7632-4369-bdf9-8ace904a05fd {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:34:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-75604715-b10c-437c-af41-33477cc0d667 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:34:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:34:27 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:35 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:37 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:34:37 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:34:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8695MB free_disk=25.01113510131836GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e1c46e9d-f04c-4e5f-975e-cf191849d243 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:34:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:34:38 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:34:38 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:34:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:34:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updating instance_info_cache with network_info: [{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:34:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:34:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:34:46 user nova-compute[75453]: INFO nova.compute.manager [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] instance snapshotting
Nov 28 14:34:46 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Beginning live snapshot process
Nov 28 14:34:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:34:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json -f qcow2 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json -f qcow2 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi1n33e59/d9eac3fe5e364f1884cdd66283f8ac2a.delta 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi1n33e59/d9eac3fe5e364f1884cdd66283f8ac2a.delta 1073741824" returned: 0 in 0.052s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 14:34:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 14:34:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75453) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 14:34:48 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 14:34:48 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:34:48 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi1n33e59/d9eac3fe5e364f1884cdd66283f8ac2a.delta /opt/stack/data/nova/instances/snapshots/tmpi1n33e59/d9eac3fe5e364f1884cdd66283f8ac2a {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:49 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi1n33e59/d9eac3fe5e364f1884cdd66283f8ac2a.delta /opt/stack/data/nova/instances/snapshots/tmpi1n33e59/d9eac3fe5e364f1884cdd66283f8ac2a" returned: 0 in 0.762s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Snapshot extracted, beginning image upload
Nov 28 14:34:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:51 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Snapshot image upload complete
Nov 28 14:34:51 user nova-compute[75453]: INFO nova.compute.manager [None req-6619b659-d3db-470e-80c6-7df1e5351489 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Took 5.32 seconds to snapshot the instance on the hypervisor.
Nov 28 14:34:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:34:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:34:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:34:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:34:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:34:54 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:34:54 user nova-compute[75453]: INFO nova.compute.claims [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Claim successful on node user
Nov 28 14:34:54 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:34:54 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:34:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:34:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:34:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:34:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:34:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:34:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:34:55 user nova-compute[75453]: DEBUG nova.policy [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b16a7dabefd4644b463e1a45a0b40dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a532227da343209095aca11e672e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:34:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:34:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:34:55 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Creating image(s)
Nov 28 14:34:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "/opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:34:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "/opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:34:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "/opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:34:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "624261993f5d3128e9fc717c72a76b2818f3810f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:34:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "624261993f5d3128e9fc717c72a76b2818f3810f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:34:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f.part --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:56 user nova-compute[75453]: DEBUG nova.network.neutron [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Successfully created port: 0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:34:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:56 user nova-compute[75453]: DEBUG nova.virt.images [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 4d7091b3-9c75-4056-a5d0-87da2e82623a was qcow2, converting to raw {{(pid=75453) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 14:34:56 user nova-compute[75453]: DEBUG nova.privsep.utils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75453) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 14:34:56 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f.part /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f.converted {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f.part /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f.converted" returned: 0 in 0.595s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f.converted --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.network.neutron [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Successfully updated port: 0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquired lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.network.neutron [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received event network-changed-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.compute.manager [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Refreshing instance network info cache due to event network-changed-0bb234d0-7036-4182-af11-1368ec192e51. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] Acquiring lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.network.neutron [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "624261993f5d3128e9fc717c72a76b2818f3810f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.093s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "624261993f5d3128e9fc717c72a76b2818f3810f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "624261993f5d3128e9fc717c72a76b2818f3810f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.network.neutron [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Updating instance_info_cache with network_info: [{"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Releasing lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Instance network_info: |[{"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] Acquired lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.network.neutron [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Refreshing network info cache for port 0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f --force-share --output=json" returned: 0 in 0.186s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f,backing_fmt=raw /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f,backing_fmt=raw /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk 1073741824" returned: 0 in 0.045s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "624261993f5d3128e9fc717c72a76b2818f3810f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624261993f5d3128e9fc717c72a76b2818f3810f --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Ensure instance console log exists: /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Start _get_guest_xml network_info=[{"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ab009df1f643da67b429233656326fc6',container_format='bare',created_at=2023-11-28T14:34:46Z,direct_url=<?>,disk_format='qcow2',id=4d7091b3-9c75-4056-a5d0-87da2e82623a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1437353739',owner='a7a532227da343209095aca11e672e87',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T14:34:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '4d7091b3-9c75-4056-a5d0-87da2e82623a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:34:57 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:34:57 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ab009df1f643da67b429233656326fc6',container_format='bare',created_at=2023-11-28T14:34:46Z,direct_url=<?>,disk_format='qcow2',id=4d7091b3-9c75-4056-a5d0-87da2e82623a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1437353739',owner='a7a532227da343209095aca11e672e87',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T14:34:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-228928258',display_name='tempest-TestStampPattern-server-228928258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-228928258',id=44,image_ref='4d7091b3-9c75-4056-a5d0-87da2e82623a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlACDPTL6lOcjqqSooAi6giBxkW7z8+nvDYlDd3hrEjP688kTjSCtRF1nVxeSXC0yyn/ol13aOaO+aT10A+GYRLWLEQzkyhrTQ//E/rJe7JWWH0vtmRcTySspOPrQW4Q==',key_name='tempest-TestStampPattern-840267874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a532227da343209095aca11e672e87',ramdisk_id='',reservation_id='r-e3jiehlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7c3306d3-7632-4369-bdf9-8ace904a05fd',image_min_disk='1',image_min_ram='0',image_owner_id='a7a532227da343209095aca11e672e87',image_owner_project_name='tempest-TestStampPattern-352626173',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-352626173-project-member',image_user_id='2b16a7dabefd4644b463e1a45a0b40dd',network_allocated='True',owner_project_name='tempest-TestStampPattern-352626173',owner_user_name='tempest-TestStampPattern-352626173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:34:55Z,user_data=None,user_id='2b16a7dabefd4644b463e1a45a0b40dd',uuid=63ba93f3-9a83-4618-b572-4cb6d1a36054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converting VIF {"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=0bb234d0-7036-4182-af11-1368ec192e51,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb234d0-70') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.objects.instance [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'pci_devices' on Instance uuid 63ba93f3-9a83-4618-b572-4cb6d1a36054 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:34:57 user nova-compute[75453]:   <uuid>63ba93f3-9a83-4618-b572-4cb6d1a36054</uuid>
Nov 28 14:34:57 user nova-compute[75453]:   <name>instance-0000002c</name>
Nov 28 14:34:57 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:34:57 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:34:57 user nova-compute[75453]:   <metadata>
Nov 28 14:34:57 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:34:57 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:34:57 user nova-compute[75453]:       <nova:name>tempest-TestStampPattern-server-228928258</nova:name>
Nov 28 14:34:57 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:34:57</nova:creationTime>
Nov 28 14:34:57 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:34:57 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:34:57 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:34:57 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:34:57 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:34:57 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:34:57 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:34:57 user nova-compute[75453]:       <nova:owner>
Nov 28 14:34:57 user nova-compute[75453]:         <nova:user uuid="2b16a7dabefd4644b463e1a45a0b40dd">tempest-TestStampPattern-352626173-project-member</nova:user>
Nov 28 14:34:57 user nova-compute[75453]:         <nova:project uuid="a7a532227da343209095aca11e672e87">tempest-TestStampPattern-352626173</nova:project>
Nov 28 14:34:57 user nova-compute[75453]:       </nova:owner>
Nov 28 14:34:57 user nova-compute[75453]:       <nova:root type="image" uuid="4d7091b3-9c75-4056-a5d0-87da2e82623a"/>
Nov 28 14:34:57 user nova-compute[75453]:       <nova:ports>
Nov 28 14:34:57 user nova-compute[75453]:         <nova:port uuid="0bb234d0-7036-4182-af11-1368ec192e51">
Nov 28 14:34:57 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 14:34:57 user nova-compute[75453]:         </nova:port>
Nov 28 14:34:57 user nova-compute[75453]:       </nova:ports>
Nov 28 14:34:57 user nova-compute[75453]:     </nova:instance>
Nov 28 14:34:57 user nova-compute[75453]:   </metadata>
Nov 28 14:34:57 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:34:57 user nova-compute[75453]:     <system>
Nov 28 14:34:57 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:34:57 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:34:57 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:34:57 user nova-compute[75453]:       <entry name="serial">63ba93f3-9a83-4618-b572-4cb6d1a36054</entry>
Nov 28 14:34:57 user nova-compute[75453]:       <entry name="uuid">63ba93f3-9a83-4618-b572-4cb6d1a36054</entry>
Nov 28 14:34:57 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:34:57 user nova-compute[75453]:     </system>
Nov 28 14:34:57 user nova-compute[75453]:   </sysinfo>
Nov 28 14:34:57 user nova-compute[75453]:   <os>
Nov 28 14:34:57 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:34:57 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:34:57 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:34:57 user nova-compute[75453]:   </os>
Nov 28 14:34:57 user nova-compute[75453]:   <features>
Nov 28 14:34:57 user nova-compute[75453]:     <acpi/>
Nov 28 14:34:57 user nova-compute[75453]:     <apic/>
Nov 28 14:34:57 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:34:57 user nova-compute[75453]:   </features>
Nov 28 14:34:57 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:34:57 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:34:57 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:34:57 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:34:57 user nova-compute[75453]:   </clock>
Nov 28 14:34:57 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:34:57 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:34:57 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:34:57 user nova-compute[75453]:   </cpu>
Nov 28 14:34:57 user nova-compute[75453]:   <devices>
Nov 28 14:34:57 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:34:57 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:34:57 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk"/>
Nov 28 14:34:57 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:34:57 user nova-compute[75453]:     </disk>
Nov 28 14:34:57 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:34:57 user nova-compute[75453]:       <mac address="fa:16:3e:75:cc:01"/>
Nov 28 14:34:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:34:57 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:34:57 user nova-compute[75453]:       <target dev="tap0bb234d0-70"/>
Nov 28 14:34:57 user nova-compute[75453]:     </interface>
Nov 28 14:34:57 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:34:57 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/console.log" append="off"/>
Nov 28 14:34:57 user nova-compute[75453]:     </serial>
Nov 28 14:34:57 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:34:57 user nova-compute[75453]:     <video>
Nov 28 14:34:57 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:34:57 user nova-compute[75453]:     </video>
Nov 28 14:34:57 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:34:57 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:34:57 user nova-compute[75453]:     </rng>
Nov 28 14:34:57 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:34:57 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:34:57 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:34:57 user nova-compute[75453]:     </memballoon>
Nov 28 14:34:57 user nova-compute[75453]:   </devices>
Nov 28 14:34:57 user nova-compute[75453]: </domain>
Nov 28 14:34:57 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-228928258',display_name='tempest-TestStampPattern-server-228928258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-228928258',id=44,image_ref='4d7091b3-9c75-4056-a5d0-87da2e82623a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlACDPTL6lOcjqqSooAi6giBxkW7z8+nvDYlDd3hrEjP688kTjSCtRF1nVxeSXC0yyn/ol13aOaO+aT10A+GYRLWLEQzkyhrTQ//E/rJe7JWWH0vtmRcTySspOPrQW4Q==',key_name='tempest-TestStampPattern-840267874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a532227da343209095aca11e672e87',ramdisk_id='',reservation_id='r-e3jiehlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7c3306d3-7632-4369-bdf9-8ace904a05fd',image_min_disk='1',image_min_ram='0',image_owner_id='a7a532227da343209095aca11e672e87',image_owner_project_name='tempest-TestStampPattern-352626173',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-352626173-project-member',image_user_id='2b16a7dabefd4644b463e1a45a0b40dd',network_allocated='True',owner_project_name='tempest-TestStampPattern-352626173',owner_user_name='tempest-TestStampPattern-352626173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:34:55Z,user_data=None,user_id='2b16a7dabefd4644b463e1a45a0b40dd',uuid=63ba93f3-9a83-4618-b572-4cb6d1a36054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converting VIF {"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=0bb234d0-7036-4182-af11-1368ec192e51,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb234d0-70') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG os_vif [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=0bb234d0-7036-4182-af11-1368ec192e51,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb234d0-70') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '335e4f84-05af-5842-b44b-a3ea53f2c44e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bb234d0-70, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bb234d0-70, col_values=(('qos', UUID('29de3508-3b71-453c-a61c-06c9c76c81b2')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bb234d0-70, col_values=(('external_ids', {'iface-id': '0bb234d0-7036-4182-af11-1368ec192e51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:cc:01', 'vm-uuid': '63ba93f3-9a83-4618-b572-4cb6d1a36054'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:34:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:58 user nova-compute[75453]: INFO os_vif [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=0bb234d0-7036-4182-af11-1368ec192e51,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb234d0-70')
Nov 28 14:34:58 user nova-compute[75453]: DEBUG nova.network.neutron [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Updated VIF entry in instance network info cache for port 0bb234d0-7036-4182-af11-1368ec192e51. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:34:58 user nova-compute[75453]: DEBUG nova.network.neutron [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Updating instance_info_cache with network_info: [{"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:34:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-6080986c-e06e-4718-b338-a1515864e777 req-c3c0dce8-7066-44a8-92a3-46f4c34d7901 service nova] Releasing lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:34:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:34:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No VIF found with MAC fa:16:3e:75:cc:01, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received event network-vif-plugged-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:34:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] No waiting events found dispatching network-vif-plugged-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:34:59 user nova-compute[75453]: WARNING nova.compute.manager [req-345165d7-d858-4663-ac68-c8e36ef50b18 req-d05d448e-8c59-4f7e-8e91-95af20370dd7 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received unexpected event network-vif-plugged-0bb234d0-7036-4182-af11-1368ec192e51 for instance with vm_state building and task_state spawning.
Nov 28 14:35:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:35:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:35:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Instance spawned successfully.
Nov 28 14:35:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:35:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:35:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:35:01 user nova-compute[75453]: INFO nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 28 14:35:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:35:01 user nova-compute[75453]: INFO nova.compute.manager [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Took 6.86 seconds to build instance.
Nov 28 14:35:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-07ca91b6-b992-4e3e-8e6a-50c15cbd7cf3 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.965s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received event network-vif-plugged-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:35:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] No waiting events found dispatching network-vif-plugged-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:35:01 user nova-compute[75453]: WARNING nova.compute.manager [req-c1eb0170-c412-4d2c-b34b-88e812c44ce9 req-783ace4a-ca2e-4353-9098-07ae569f6ddf service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received unexpected event network-vif-plugged-0bb234d0-7036-4182-af11-1368ec192e51 for instance with vm_state active and task_state None.
Nov 28 14:35:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-changed-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Refreshing instance network info cache due to event network-changed-9b815f80-08ff-4406-840c-b2152652eea6. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] Acquiring lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] Acquired lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG nova.network.neutron [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Refreshing network info cache for port 9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG nova.objects.instance [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'flavor' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG nova.network.neutron [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updated VIF entry in instance network info cache for port 9b815f80-08ff-4406-840c-b2152652eea6. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG nova.network.neutron [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-21397c0e-fe30-403a-aa02-e372c91bd790 req-a6e7620c-bc6f-4d00-aa68-4f9fe74e3ea5 service nova] Releasing lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:05 user nova-compute[75453]: INFO nova.compute.manager [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Attaching volume c8d9ba63-449a-49d5-96b4-5b2d5e30e12a to /dev/vdb
Nov 28 14:35:06 user nova-compute[75453]: DEBUG os_brick.utils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edc72b9-be65-4f00-86df-7d6279fa4deb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb9968-591e-4e2c-8676-a00a739dab4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e77f19-43ee-4192-b154-21776e84801a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff30c60-2949-4191-804e-e8843ffaccc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:35:06 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:35:06 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9b83ec-15a4-40d3-a588-d7331f282ea2]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG os_brick.utils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:35:06 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating existing volume attachment record: b717e8dc-dab2-459b-92f6-ec2bac4f1f6d {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:35:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:12 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:35:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkyJNnBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:35:12 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:35:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:35:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:35:12 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:35:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:35:12 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:35:12 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:35:12 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6927bf-aee0-4374-8076-9dbfb4a4b57b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:35:13 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[600bb1fe-a4a0-46c1-b41f-0ec67e396486]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a] added
Nov 28 14:35:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e413d3c-3237-48c2-8e35-55279d2b2a01]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e327dcc5-fccb-42e7-9a2c-2d4e40026aee]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PkyJNnBQ {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PkyJNnBQ" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8af554-19aa-44ef-a49b-dfab0d4770c1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PkyJNnBQ'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b6e86-86ca-4088-a998-f2c43390edb2]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada06df2-e727-4680-bf48-461c6966f588]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:35:13 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:35:13 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:35:13 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:35:13 user nova-compute[75453]: 
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[949afde3-55a5-4822-a45f-2e5cd6e8b736]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a, portal: 172.16.0.220,3260]
Nov 28 14:35:13 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a, portal: 172.16.0.220,3260] successful.
Nov 28 14:35:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e853a34-0b68-445d-aa59-6d3b1992581d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[51963bbb-9431-4f74-ace8-ac12d76ebc61]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:35:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:35:13 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea39a4ab-d6b6-4085-bb52-df361b54e847]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkyJNnBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:35:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:35:14 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23935333861363435', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:35:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935333861363435', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:35:14 user nova-compute[75453]: DEBUG nova.objects.instance [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'flavor' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:35:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:35:14 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:35:14 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:35:14 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:35:14 user nova-compute[75453]:   <serial>c8d9ba63-449a-49d5-96b4-5b2d5e30e12a</serial>
Nov 28 14:35:14 user nova-compute[75453]: </disk>
Nov 28 14:35:14 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:35:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:35:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:35:14 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No VIF found with MAC fa:16:3e:12:cc:ed, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:35:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-81fd237d-a8e5-4a27-bd0b-a0a571993ecd tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.871s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:15 user nova-compute[75453]: INFO nova.compute.manager [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Rescuing
Nov 28 14:35:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:35:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquired lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:35:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Releasing lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-unplugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG nova.compute.manager [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-unplugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:35:16 user nova-compute[75453]: WARNING nova.compute.manager [req-47724b0c-7921-4a1d-a8e7-971b726c9252 req-8159e069-8fb1-46b6-867b-e91ea0001145 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-unplugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state active and task_state rescuing.
Nov 28 14:35:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Instance destroyed successfully.
Nov 28 14:35:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Attempting rescue
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75453) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Instance directory exists: not creating {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 14:35:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Creating image(s)
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue" returned: 0 in 0.052s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'migration_context' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.base [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<e1c46e9d-f04c-4e5f-975e-cf191849d243> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Start _get_guest_xml network_info=[{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "vif_mac": "fa:16:3e:12:cc:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'resources' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.base [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<e1c46e9d-f04c-4e5f-975e-cf191849d243> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'numa_topology' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.base [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<e1c46e9d-f04c-4e5f-975e-cf191849d243> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:35:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:35:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.base [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<e1c46e9d-f04c-4e5f-975e-cf191849d243> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2143021861',display_name='tempest-ServerRescueNegativeTestJSON-server-2143021861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2143021861',id=43,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0y2cqY3F/6K6W4DPXhIl7hrZlCa2hSi8sETskoLDchgOrSOVppHWCOUoYleJrOOHP3WBIK8O/1fXEaJPGh0AUIhsm1RDrjptysW476kRslDpBjaJqcktMwW7JzfrzV5A==',key_name='tempest-keypair-1935967308',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:33:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-vuiayuhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:33:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ac79717e12544d39215874f9b99ccf2',uuid=e1c46e9d-f04c-4e5f-975e-cf191849d243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "vif_mac": "fa:16:3e:12:cc:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "vif_mac": "fa:16:3e:12:cc:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:cc:ed,bridge_name='br-int',has_traffic_filtering=True,id=9b815f80-08ff-4406-840c-b2152652eea6,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b815f80-08') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'pci_devices' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.objects.base [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Object Instance<e1c46e9d-f04c-4e5f-975e-cf191849d243> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75453) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:35:17 user nova-compute[75453]:   <uuid>e1c46e9d-f04c-4e5f-975e-cf191849d243</uuid>
Nov 28 14:35:17 user nova-compute[75453]:   <name>instance-0000002b</name>
Nov 28 14:35:17 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:35:17 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:35:17 user nova-compute[75453]:   <metadata>
Nov 28 14:35:17 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:35:17 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:35:17 user nova-compute[75453]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2143021861</nova:name>
Nov 28 14:35:17 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:35:17</nova:creationTime>
Nov 28 14:35:17 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:35:17 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:35:17 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:35:17 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:35:17 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:35:17 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:35:17 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:35:17 user nova-compute[75453]:       <nova:owner>
Nov 28 14:35:17 user nova-compute[75453]:         <nova:user uuid="7ac79717e12544d39215874f9b99ccf2">tempest-ServerRescueNegativeTestJSON-1690568266-project-member</nova:user>
Nov 28 14:35:17 user nova-compute[75453]:         <nova:project uuid="c90c4a02d30c48c7b6ee993b9b213c2b">tempest-ServerRescueNegativeTestJSON-1690568266</nova:project>
Nov 28 14:35:17 user nova-compute[75453]:       </nova:owner>
Nov 28 14:35:17 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:35:17 user nova-compute[75453]:       <nova:ports>
Nov 28 14:35:17 user nova-compute[75453]:         <nova:port uuid="9b815f80-08ff-4406-840c-b2152652eea6">
Nov 28 14:35:17 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 14:35:17 user nova-compute[75453]:         </nova:port>
Nov 28 14:35:17 user nova-compute[75453]:       </nova:ports>
Nov 28 14:35:17 user nova-compute[75453]:     </nova:instance>
Nov 28 14:35:17 user nova-compute[75453]:   </metadata>
Nov 28 14:35:17 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:35:17 user nova-compute[75453]:     <system>
Nov 28 14:35:17 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:35:17 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:35:17 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:35:17 user nova-compute[75453]:       <entry name="serial">e1c46e9d-f04c-4e5f-975e-cf191849d243</entry>
Nov 28 14:35:17 user nova-compute[75453]:       <entry name="uuid">e1c46e9d-f04c-4e5f-975e-cf191849d243</entry>
Nov 28 14:35:17 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:35:17 user nova-compute[75453]:     </system>
Nov 28 14:35:17 user nova-compute[75453]:   </sysinfo>
Nov 28 14:35:17 user nova-compute[75453]:   <os>
Nov 28 14:35:17 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:35:17 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:35:17 user nova-compute[75453]:   </os>
Nov 28 14:35:17 user nova-compute[75453]:   <features>
Nov 28 14:35:17 user nova-compute[75453]:     <acpi/>
Nov 28 14:35:17 user nova-compute[75453]:     <apic/>
Nov 28 14:35:17 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:35:17 user nova-compute[75453]:   </features>
Nov 28 14:35:17 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:35:17 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:35:17 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:35:17 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:35:17 user nova-compute[75453]:   </clock>
Nov 28 14:35:17 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:35:17 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:35:17 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:35:17 user nova-compute[75453]:   </cpu>
Nov 28 14:35:17 user nova-compute[75453]:   <devices>
Nov 28 14:35:17 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:35:17 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:35:17 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue"/>
Nov 28 14:35:17 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:35:17 user nova-compute[75453]:     </disk>
Nov 28 14:35:17 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:35:17 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:35:17 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk"/>
Nov 28 14:35:17 user nova-compute[75453]:       <target dev="vdb" bus="virtio"/>
Nov 28 14:35:17 user nova-compute[75453]:     </disk>
Nov 28 14:35:17 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:35:17 user nova-compute[75453]:       <mac address="fa:16:3e:12:cc:ed"/>
Nov 28 14:35:17 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:35:17 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:35:17 user nova-compute[75453]:       <target dev="tap9b815f80-08"/>
Nov 28 14:35:17 user nova-compute[75453]:     </interface>
Nov 28 14:35:17 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:35:17 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/console.log" append="off"/>
Nov 28 14:35:17 user nova-compute[75453]:     </serial>
Nov 28 14:35:17 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:35:17 user nova-compute[75453]:     <video>
Nov 28 14:35:17 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:35:17 user nova-compute[75453]:     </video>
Nov 28 14:35:17 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:35:17 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:35:17 user nova-compute[75453]:     </rng>
Nov 28 14:35:17 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:35:17 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:35:17 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:35:17 user nova-compute[75453]:     </memballoon>
Nov 28 14:35:17 user nova-compute[75453]:   </devices>
Nov 28 14:35:17 user nova-compute[75453]: </domain>
Nov 28 14:35:17 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:35:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Instance destroyed successfully.
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:35:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] No VIF found with MAC fa:16:3e:12:cc:ed, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:35:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:35:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:35:18 user nova-compute[75453]: WARNING nova.compute.manager [req-1ee59cdf-5eda-42b8-b555-52801af2938d req-577eaacc-d7ea-4671-84c8-7397f5df292e service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state active and task_state rescuing.
Nov 28 14:35:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:35:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:35:20 user nova-compute[75453]: WARNING nova.compute.manager [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state active and task_state rescuing.
Nov 28 14:35:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:35:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:35:20 user nova-compute[75453]: WARNING nova.compute.manager [req-700a6e82-f626-4ee3-9c3f-4c4397835e0a req-7c7d625d-3f3d-46bf-84fc-a6001db2dd30 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state active and task_state rescuing.
Nov 28 14:35:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ffa9a9c0-d6f3-4942-bc58-b1c446e4857a tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:35:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:29 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:35:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:35:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:35 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:35:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:35:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:35:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=24.863811492919922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e1c46e9d-f04c-4e5f-975e-cf191849d243 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:35:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:35:42 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:35:42 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:35:42 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:35:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:35:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:35:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:35:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updating instance_info_cache with network_info: [{"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:35:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:35:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:35:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:35:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:35:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:35:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:35:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:35:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:36:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:36:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:36:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:36:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:36:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:36:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:36:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:36:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:36:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:36:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:36:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:36:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:36:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:36:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:36:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=24.862903594970703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e1c46e9d-f04c-4e5f-975e-cf191849d243 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:36:39 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:36:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:36:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:36:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:36:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:36:44 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:36:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:36:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:36:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:36:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received event network-changed-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Refreshing instance network info cache due to event network-changed-0bb234d0-7036-4182-af11-1368ec192e51. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] Acquiring lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] Acquired lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Refreshing network info cache for port 0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Updated VIF entry in instance network info cache for port 0bb234d0-7036-4182-af11-1368ec192e51. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Updating instance_info_cache with network_info: [{"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-bd5d53cf-8966-4060-803c-87e345203eab req-7d6b76bf-ccac-47b7-b2e2-c33d1d20f306 service nova] Releasing lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG nova.objects.instance [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'flavor' on Instance uuid 63ba93f3-9a83-4618-b572-4cb6d1a36054 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:36:46 user nova-compute[75453]: INFO nova.compute.manager [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Attaching volume 0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 to /dev/vdb
Nov 28 14:36:46 user nova-compute[75453]: DEBUG os_brick.utils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8452edfe-57e0-496d-9867-0f6f4707e429]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85c6741-1c48-4cb7-916f-452adcd16b0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc4a406-35b0-4e75-974a-cf319eed3c85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe363cc-b5ab-41b3-a8b0-0badc8d595eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:36:46 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:36:46 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b6af40-22a5-4667-8b42-f3bb8ee4961e]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG os_brick.utils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:36:46 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Updating existing volume attachment record: 023ed377-b22d-4788-a9dc-532395ce4aee {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:36:47 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:36:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:36:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQiWreSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:36:53 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:36:53 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:36:53 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff40ed1-970b-49a2-81b0-cdd6709e5820]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:36:53 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2deeb6-f6b4-40a5-ab94-46e6003cd903]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857] added
Nov 28 14:36:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecd547d-7c4e-478c-82b3-f03293ede1d7]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ad88cd-ea8d-4f6a-9359-d7ecbd723d05]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQiWreSR {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQiWreSR" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda7df30-c78a-4bb3-b188-3115a675c5dc]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lQiWreSR'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf23a1d-fd93-4701-a71b-f55054436688]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[542c0a95-6351-4d5f-a256-e2d6209d9810]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:36:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:36:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d6378c-de83-467e-8179-d0bd3f41f4a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857, portal: 172.16.0.220,3260]
Nov 28 14:36:53 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857, portal: 172.16.0.220,3260] successful.
Nov 28 14:36:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ff9314-386f-484c-b255-31ba7541537a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71cb0f7-722b-43a1-8957-c6a53eea628d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:36:53 user nova-compute[75453]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 (non-flash)
Nov 28 14:36:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:36:53 user nova-compute[75453]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 (non-flash)
Nov 28 14:36:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6dbe15-223f-46f8-b8e8-64ac4caff7a2]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:36:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQiWreSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:36:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:36:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26666643032653563', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:36:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666643032653563', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:36:54 user nova-compute[75453]: DEBUG nova.objects.instance [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'flavor' on Instance uuid 63ba93f3-9a83-4618-b572-4cb6d1a36054 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:36:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:36:54 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:36:54 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:36:54 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:36:54 user nova-compute[75453]:   <serial>0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857</serial>
Nov 28 14:36:54 user nova-compute[75453]: </disk>
Nov 28 14:36:54 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:36:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:36:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:36:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] No VIF found with MAC fa:16:3e:75:cc:01, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:36:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-be65b53c-eb7a-4b52-83c3-85aebca7a844 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.552s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:36:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:36:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:36:57 user nova-compute[75453]: INFO nova.compute.manager [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Detaching volume 0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857
Nov 28 14:36:57 user nova-compute[75453]: INFO nova.virt.block_device [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Attempting to driver detach volume 0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 from mountpoint /dev/vdb
Nov 28 14:36:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Attempting to detach device vdb from instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:36:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:36:57 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:36:57 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:36:57 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:36:57 user nova-compute[75453]:   <serial>0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857</serial>
Nov 28 14:36:57 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:36:57 user nova-compute[75453]: </disk>
Nov 28 14:36:57 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:36:57 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Successfully detached device vdb from instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 from the persistent domain config.
Nov 28 14:36:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:36:57 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:36:57 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:36:57 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:36:57 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:36:57 user nova-compute[75453]:   <serial>0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857</serial>
Nov 28 14:36:57 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:36:57 user nova-compute[75453]: </disk>
Nov 28 14:36:57 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:36:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:36:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:36:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:06 user nova-compute[75453]: INFO nova.compute.manager [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Unrescuing
Nov 28 14:37:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:37:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquired lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:37:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG nova.network.neutron [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Releasing lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG nova.objects.instance [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'flavor' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-unplugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG nova.compute.manager [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-unplugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:37:07 user nova-compute[75453]: WARNING nova.compute.manager [req-fe2c90cc-6ccf-4369-9523-1d542b1e6bc5 req-62f3e62e-b960-4f4d-a1c6-a92b4af440cd service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-unplugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:37:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:07 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Instance destroyed successfully.
Nov 28 14:37:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:37:09 user nova-compute[75453]: WARNING nova.compute.manager [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:37:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:37:09 user nova-compute[75453]: WARNING nova.compute.manager [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:37:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:09 user nova-compute[75453]: DEBUG nova.compute.manager [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:37:09 user nova-compute[75453]: WARNING nova.compute.manager [req-91f39f9c-f9c2-41e8-8678-fa736a928263 req-90c1528a-17bb-4e02-9c0c-8dc32b07ac0f service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state rescued and task_state unrescuing.
Nov 28 14:37:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-8a03dabd-0668-4b44-9e76-dcf1316e93b0 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:37:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:18 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 is timed out.
Nov 28 14:37:18 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Successfully detached device vdb from instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 from the live domain config.
Nov 28 14:37:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQiWreSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:37:18 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b2c7f1-e2a1-46fb-bee6-5fb5039c126e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:37:18 user nova-compute[75453]: No targets found.
Nov 28 14:37:18 user nova-compute[75453]: iSNS:
Nov 28 14:37:18 user nova-compute[75453]: No targets found.
Nov 28 14:37:18 user nova-compute[75453]: STATIC:
Nov 28 14:37:18 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a
Nov 28 14:37:18 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:37:18 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:37:18 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857
Nov 28 14:37:18 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:37:18 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:37:18 user nova-compute[75453]: FIRMWARE:
Nov 28 14:37:18 user nova-compute[75453]: No targets found.
Nov 28 14:37:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:37:18 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:37:18 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[17549fdb-91ca-4780-8cc3-18fc453701dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[71342322-11fe-457d-8a78-835c1d51baf1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:37:18 user nova-compute[75453]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 (non-flash)
Nov 28 14:37:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:37:18 user nova-compute[75453]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 (non-flash)
Nov 28 14:37:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f021851d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d375f7ee-8111-410d-be22-b089e6bf9701]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3ff0ab-71f9-4904-94e6-3512e67d8923]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb5ae65-84dd-44f8-9396-36322ba6e694]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d949cb3-105f-4638-ab47-285a95b7e297]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b6cd30-a114-4c5c-b900-b6cb092bed47]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7fe54e-d89f-4488-b132-c8c28254959b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857, portal: 172.16.0.220,3260]
Nov 28 14:37:18 user nova-compute[75453]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857, portal: 172.16.0.220,3260] successful.
Nov 28 14:37:18 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f0c33fe-ac1c-4b8d-917c-2ddfffeb9857 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ad621c-3dc3-4e6b-9d70-b70cc2a8a194]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] <== disconnect_volume: return (294ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:37:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:19 user nova-compute[75453]: DEBUG nova.objects.instance [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'flavor' on Instance uuid 63ba93f3-9a83-4618-b572-4cb6d1a36054 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:37:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-6b957cd7-14d3-4e64-8a83-492cac536f09 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:37:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:37:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:37:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:37:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:32 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:37:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:37:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:37:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:37:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8589MB free_disk=24.861175537109375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e1c46e9d-f04c-4e5f-975e-cf191849d243 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 63ba93f3-9a83-4618-b572-4cb6d1a36054 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:37:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:37:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:37:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:37:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:37:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:37:45 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:37:46 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [{"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:37:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-23f4cfb9-18d6-419b-9fb0-23a0da9da00f" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:37:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:37:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:37:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received event network-changed-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Refreshing instance network info cache due to event network-changed-0bb234d0-7036-4182-af11-1368ec192e51. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] Acquiring lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] Acquired lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG nova.network.neutron [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Refreshing network info cache for port 0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:48 user nova-compute[75453]: INFO nova.compute.manager [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Terminating instance
Nov 28 14:37:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received event network-vif-unplugged-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] No waiting events found dispatching network-vif-unplugged-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG nova.compute.manager [req-a70e5f8c-499c-47e6-bb41-0987d080ede0 req-68ea22aa-0410-4b4c-8cd5-9bc8f6db2b8e service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received event network-vif-unplugged-0bb234d0-7036-4182-af11-1368ec192e51 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG nova.network.neutron [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Updated VIF entry in instance network info cache for port 0bb234d0-7036-4182-af11-1368ec192e51. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG nova.network.neutron [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Updating instance_info_cache with network_info: [{"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-99cbf873-b475-4506-8321-b814936836bc req-6c0b9986-0856-4ede-a080-7fd1fa962ad5 service nova] Releasing lock "refresh_cache-63ba93f3-9a83-4618-b572-4cb6d1a36054" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:37:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Instance destroyed successfully.
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.objects.instance [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'resources' on Instance uuid 63ba93f3-9a83-4618-b572-4cb6d1a36054 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-228928258',display_name='tempest-TestStampPattern-server-228928258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-228928258',id=44,image_ref='4d7091b3-9c75-4056-a5d0-87da2e82623a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlACDPTL6lOcjqqSooAi6giBxkW7z8+nvDYlDd3hrEjP688kTjSCtRF1nVxeSXC0yyn/ol13aOaO+aT10A+GYRLWLEQzkyhrTQ//E/rJe7JWWH0vtmRcTySspOPrQW4Q==',key_name='tempest-TestStampPattern-840267874',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:35:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7a532227da343209095aca11e672e87',ramdisk_id='',reservation_id='r-e3jiehlv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7c3306d3-7632-4369-bdf9-8ace904a05fd',image_min_disk='1',image_min_ram='0',image_owner_id='a7a532227da343209095aca11e672e87',image_owner_project_name='tempest-TestStampPattern-352626173',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-352626173-project-member',image_user_id='2b16a7dabefd4644b463e1a45a0b40dd',owner_project_name='tempest-TestStampPattern-352626173',owner_user_name='tempest-TestStampPattern-352626173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:35:01Z,user_data=None,user_id='2b16a7dabefd4644b463e1a45a0b40dd',uuid=63ba93f3-9a83-4618-b572-4cb6d1a36054,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converting VIF {"id": "0bb234d0-7036-4182-af11-1368ec192e51", "address": "fa:16:3e:75:cc:01", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb234d0-70", "ovs_interfaceid": "0bb234d0-7036-4182-af11-1368ec192e51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=0bb234d0-7036-4182-af11-1368ec192e51,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb234d0-70') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG os_vif [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=0bb234d0-7036-4182-af11-1368ec192e51,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb234d0-70') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bb234d0-70, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29de3508-3b71-453c-a61c-06c9c76c81b2) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:37:49 user nova-compute[75453]: INFO os_vif [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=0bb234d0-7036-4182-af11-1368ec192e51,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb234d0-70')
Nov 28 14:37:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Deleting instance files /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054_del
Nov 28 14:37:49 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Deletion of /opt/stack/data/nova/instances/63ba93f3-9a83-4618-b572-4cb6d1a36054_del complete
Nov 28 14:37:49 user nova-compute[75453]: INFO nova.compute.manager [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 14:37:49 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:37:49 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Took 0.39 seconds to deallocate network for instance.
Nov 28 14:37:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-4a83f89f-0ebe-4379-9348-b70033bed831 req-b53d527e-e1e8-4e35-9d13-972a59ddf189 service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received event network-vif-deleted-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:37:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:49 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Deleted allocations for instance 63ba93f3-9a83-4618-b572-4cb6d1a36054
Nov 28 14:37:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-4bb9b521-2b6e-484a-a100-580cfa9e260f tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.633s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received event network-vif-plugged-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:37:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] Acquiring lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:37:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:37:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] Lock "63ba93f3-9a83-4618-b572-4cb6d1a36054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:37:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] No waiting events found dispatching network-vif-plugged-0bb234d0-7036-4182-af11-1368ec192e51 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:37:50 user nova-compute[75453]: WARNING nova.compute.manager [req-7acd9ed2-bd49-4572-95a8-616390292861 req-cfd3a9ac-3947-49b6-8daa-309f417876bb service nova] [instance: 63ba93f3-9a83-4618-b572-4cb6d1a36054] Received unexpected event network-vif-plugged-0bb234d0-7036-4182-af11-1368ec192e51 for instance with vm_state deleted and task_state None.
Nov 28 14:37:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:37:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:38:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:33 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:33 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:36 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:38:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:36 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:38:38 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:38:38 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:38:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=24.86180877685547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 7c3306d3-7632-4369-bdf9-8ace904a05fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e1c46e9d-f04c-4e5f-975e-cf191849d243 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:38:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:38:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:39 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:38:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:38:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:38:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:42 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:42 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:38:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:38:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:38:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:38:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updating instance_info_cache with network_info: [{"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:38:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-b1db2136-7fba-4701-bbc0-afee6b009a3c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:38:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:38:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-changed-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Refreshing instance network info cache due to event network-changed-03247349-1758-4904-ae30-79ca21ccdd7c. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] Acquiring lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] Acquired lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG nova.network.neutron [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Refreshing network info cache for port 03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:46 user nova-compute[75453]: INFO nova.compute.manager [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Terminating instance
Nov 28 14:38:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-unplugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] No waiting events found dispatching network-vif-unplugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:38:46 user nova-compute[75453]: DEBUG nova.compute.manager [req-03ed0405-77eb-46fc-93da-58f3be2215e1 req-85eca336-7518-43da-81bf-205ec08ef641 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-unplugged-03247349-1758-4904-ae30-79ca21ccdd7c for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG nova.network.neutron [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updated VIF entry in instance network info cache for port 03247349-1758-4904-ae30-79ca21ccdd7c. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG nova.network.neutron [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updating instance_info_cache with network_info: [{"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-acc13eca-5f46-40a9-b4f3-e3e89f74819b req-3cf6c702-4893-4467-a1f8-12b86406ebe2 service nova] Releasing lock "refresh_cache-7c3306d3-7632-4369-bdf9-8ace904a05fd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Instance destroyed successfully.
Nov 28 14:38:47 user nova-compute[75453]: DEBUG nova.objects.instance [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lazy-loading 'resources' on Instance uuid 7c3306d3-7632-4369-bdf9-8ace904a05fd {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-102692577',display_name='tempest-TestStampPattern-server-102692577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-102692577',id=42,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSlACDPTL6lOcjqqSooAi6giBxkW7z8+nvDYlDd3hrEjP688kTjSCtRF1nVxeSXC0yyn/ol13aOaO+aT10A+GYRLWLEQzkyhrTQ//E/rJe7JWWH0vtmRcTySspOPrQW4Q==',key_name='tempest-TestStampPattern-840267874',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:31:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7a532227da343209095aca11e672e87',ramdisk_id='',reservation_id='r-yjsfr5c2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-352626173',owner_user_name='tempest-TestStampPattern-352626173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:34:52Z,user_data=None,user_id='2b16a7dabefd4644b463e1a45a0b40dd',uuid=7c3306d3-7632-4369-bdf9-8ace904a05fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converting VIF {"id": "03247349-1758-4904-ae30-79ca21ccdd7c", "address": "fa:16:3e:8e:79:1c", "network": {"id": "21c4f328-f0be-4825-8ebf-c2ba4b011ed0", "bridge": "br-int", "label": "tempest-TestStampPattern-465631559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a532227da343209095aca11e672e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03247349-17", "ovs_interfaceid": "03247349-1758-4904-ae30-79ca21ccdd7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:79:1c,bridge_name='br-int',has_traffic_filtering=True,id=03247349-1758-4904-ae30-79ca21ccdd7c,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247349-17') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG os_vif [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:79:1c,bridge_name='br-int',has_traffic_filtering=True,id=03247349-1758-4904-ae30-79ca21ccdd7c,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247349-17') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03247349-17, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3755ea7a-bacd-49ca-bd30-dbf1bf86e592) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:38:47 user nova-compute[75453]: INFO os_vif [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:79:1c,bridge_name='br-int',has_traffic_filtering=True,id=03247349-1758-4904-ae30-79ca21ccdd7c,network=Network(21c4f328-f0be-4825-8ebf-c2ba4b011ed0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03247349-17')
Nov 28 14:38:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Deleting instance files /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd_del
Nov 28 14:38:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Deletion of /opt/stack/data/nova/instances/7c3306d3-7632-4369-bdf9-8ace904a05fd_del complete
Nov 28 14:38:47 user nova-compute[75453]: INFO nova.compute.manager [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 14:38:47 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:48 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:38:48 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Took 0.83 seconds to deallocate network for instance.
Nov 28 14:38:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:48 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:38:48 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:38:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:48 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Deleted allocations for instance 7c3306d3-7632-4369-bdf9-8ace904a05fd
Nov 28 14:38:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-7000269c-cff5-47af-95ad-3aa9cadad5d1 tempest-TestStampPattern-352626173 tempest-TestStampPattern-352626173-project-member] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.170s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] No waiting events found dispatching network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:38:49 user nova-compute[75453]: WARNING nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received unexpected event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c for instance with vm_state deleted and task_state None.
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] No waiting events found dispatching network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:38:49 user nova-compute[75453]: WARNING nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received unexpected event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c for instance with vm_state deleted and task_state None.
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] No waiting events found dispatching network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:38:49 user nova-compute[75453]: WARNING nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received unexpected event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c for instance with vm_state deleted and task_state None.
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-unplugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] No waiting events found dispatching network-vif-unplugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:38:49 user nova-compute[75453]: WARNING nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received unexpected event network-vif-unplugged-03247349-1758-4904-ae30-79ca21ccdd7c for instance with vm_state deleted and task_state None.
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Acquiring lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] Lock "7c3306d3-7632-4369-bdf9-8ace904a05fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] No waiting events found dispatching network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:38:49 user nova-compute[75453]: WARNING nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received unexpected event network-vif-plugged-03247349-1758-4904-ae30-79ca21ccdd7c for instance with vm_state deleted and task_state None.
Nov 28 14:38:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-7653290c-8bcc-480b-bd04-7caf54d1c44a req-7f80e9a6-5bcb-41af-af67-69afaf51e29b service nova] [instance: 7c3306d3-7632-4369-bdf9-8ace904a05fd] Received event network-vif-deleted-03247349-1758-4904-ae30-79ca21ccdd7c {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:38:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-changed-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Refreshing instance network info cache due to event network-changed-9b815f80-08ff-4406-840c-b2152652eea6. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] Acquiring lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] Acquired lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG nova.network.neutron [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Refreshing network info cache for port 9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:38:58 user nova-compute[75453]: INFO nova.compute.manager [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Detaching volume c8d9ba63-449a-49d5-96b4-5b2d5e30e12a
Nov 28 14:38:58 user nova-compute[75453]: INFO nova.virt.block_device [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Attempting to driver detach volume c8d9ba63-449a-49d5-96b4-5b2d5e30e12a from mountpoint /dev/vdb
Nov 28 14:38:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Attempting to detach device vdb from instance e1c46e9d-f04c-4e5f-975e-cf191849d243 from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:38:58 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:38:58 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:38:58 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:38:58 user nova-compute[75453]:   <serial>c8d9ba63-449a-49d5-96b4-5b2d5e30e12a</serial>
Nov 28 14:38:58 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:38:58 user nova-compute[75453]: </disk>
Nov 28 14:38:58 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:38:58 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Successfully detached device vdb from instance e1c46e9d-f04c-4e5f-975e-cf191849d243 from the persistent domain config.
Nov 28 14:38:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1c46e9d-f04c-4e5f-975e-cf191849d243 from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:38:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:38:58 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:38:58 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:38:58 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:38:58 user nova-compute[75453]:   <serial>c8d9ba63-449a-49d5-96b4-5b2d5e30e12a</serial>
Nov 28 14:38:58 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:38:58 user nova-compute[75453]: </disk>
Nov 28 14:38:58 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:38:59 user nova-compute[75453]: DEBUG nova.network.neutron [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updated VIF entry in instance network info cache for port 9b815f80-08ff-4406-840c-b2152652eea6. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:38:59 user nova-compute[75453]: DEBUG nova.network.neutron [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:38:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b233c0f8-6657-4761-9613-0450de073c42 req-ff43d81e-181d-4e45-a861-9487e8b08b21 service nova] Releasing lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:38:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:39:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-changed-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:39:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Refreshing instance network info cache due to event network-changed-9b815f80-08ff-4406-840c-b2152652eea6. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:39:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] Acquiring lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:39:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] Acquired lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:39:00 user nova-compute[75453]: DEBUG nova.network.neutron [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Refreshing network info cache for port 9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:39:00 user nova-compute[75453]: DEBUG nova.network.neutron [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updated VIF entry in instance network info cache for port 9b815f80-08ff-4406-840c-b2152652eea6. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:39:00 user nova-compute[75453]: DEBUG nova.network.neutron [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:39:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b2133bd6-f605-4564-8545-7058567991e0 req-9881cdac-d6b7-4bd2-a4e0-c38d9f0272e5 service nova] Releasing lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:39:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:39:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:39:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:39:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:39:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:39:19 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1c46e9d-f04c-4e5f-975e-cf191849d243 is timed out.
Nov 28 14:39:19 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Successfully detached device vdb from instance e1c46e9d-f04c-4e5f-975e-cf191849d243 from the live domain config.
Nov 28 14:39:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkyJNnBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:39:19 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4038e2c-0c61-4bde-9763-b2bba446464a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:39:19 user nova-compute[75453]: No targets found.
Nov 28 14:39:19 user nova-compute[75453]: iSNS:
Nov 28 14:39:19 user nova-compute[75453]: No targets found.
Nov 28 14:39:19 user nova-compute[75453]: STATIC:
Nov 28 14:39:19 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a
Nov 28 14:39:19 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:39:19 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:39:19 user nova-compute[75453]: FIRMWARE:
Nov 28 14:39:19 user nova-compute[75453]: No targets found.
Nov 28 14:39:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:39:19 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:39:19 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b159e-8ab8-4ed3-9ce0-e7b96bac5cf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[85914cbf-5ee3-470d-b505-13e4af83b910]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:39:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a (non-flash)
Nov 28 14:39:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02543a3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e4a3a2-0742-48d7-896e-402e2b72d436]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[829830d9-e64b-41b2-b606-6144646d1253]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[615c2d72-a42b-4db2-880b-c9be351fefab]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56b3884-18e0-4070-a856-58c6081b12af]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf700c6-3c01-4861-9897-9a16014fce2d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed97cae-a748-4df5-ad32-9d7f226dc24e]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a, portal: 172.16.0.220,3260]
Nov 28 14:39:19 user nova-compute[75453]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a, portal: 172.16.0.220,3260] successful.
Nov 28 14:39:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d9ba63-449a-49d5-96b4-5b2d5e30e12a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b9320-a777-4f4f-9caf-6efdcce8d738]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] <== disconnect_volume: return (309ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:39:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:39:20 user nova-compute[75453]: DEBUG nova.objects.instance [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'flavor' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:39:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-f4a3b6b3-9ce2-4a70-bf1c-020472dc63f9 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.724s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:39:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:39:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:39:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:34 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:39:34 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:39:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:39:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:39:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:39:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:39:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:39:37 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:39:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:37 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:39:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:39:39 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:39:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=24.986083984375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance e1c46e9d-f04c-4e5f-975e-cf191849d243 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:39:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:39:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:39:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:39:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:39:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:39:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:39:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:39:44 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [{"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:39:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-e1c46e9d-f04c-4e5f-975e-cf191849d243" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:39:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:39:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:39:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:39:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:39:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:39:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:39:49 user nova-compute[75453]: INFO nova.compute.manager [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Terminating instance
Nov 28 14:39:49 user nova-compute[75453]: DEBUG nova.compute.manager [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-unplugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-unplugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:39:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-812e6f5e-c136-4cd4-b7cf-132f0339a43a req-7c522272-2682-4942-b9cc-b28d8ab08b40 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-unplugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:39:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Instance destroyed successfully.
Nov 28 14:39:50 user nova-compute[75453]: DEBUG nova.objects.instance [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'resources' on Instance uuid e1c46e9d-f04c-4e5f-975e-cf191849d243 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2143021861',display_name='tempest-ServerRescueNegativeTestJSON-server-2143021861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2143021861',id=43,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0y2cqY3F/6K6W4DPXhIl7hrZlCa2hSi8sETskoLDchgOrSOVppHWCOUoYleJrOOHP3WBIK8O/1fXEaJPGh0AUIhsm1RDrjptysW476kRslDpBjaJqcktMwW7JzfrzV5A==',key_name='tempest-keypair-1935967308',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-vuiayuhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ac79717e12544d39215874f9b99ccf2',uuid=e1c46e9d-f04c-4e5f-975e-cf191849d243,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "9b815f80-08ff-4406-840c-b2152652eea6", "address": "fa:16:3e:12:cc:ed", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b815f80-08", "ovs_interfaceid": "9b815f80-08ff-4406-840c-b2152652eea6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:cc:ed,bridge_name='br-int',has_traffic_filtering=True,id=9b815f80-08ff-4406-840c-b2152652eea6,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b815f80-08') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG os_vif [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:cc:ed,bridge_name='br-int',has_traffic_filtering=True,id=9b815f80-08ff-4406-840c-b2152652eea6,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b815f80-08') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b815f80-08, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3dd0f93-7126-4f80-8603-3e353ab1cca1) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:39:50 user nova-compute[75453]: INFO os_vif [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:cc:ed,bridge_name='br-int',has_traffic_filtering=True,id=9b815f80-08ff-4406-840c-b2152652eea6,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b815f80-08')
Nov 28 14:39:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Deleting instance files /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243_del
Nov 28 14:39:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Deletion of /opt/stack/data/nova/instances/e1c46e9d-f04c-4e5f-975e-cf191849d243_del complete
Nov 28 14:39:50 user nova-compute[75453]: INFO nova.compute.manager [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 14:39:50 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:39:50 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:39:51 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Took 1.50 seconds to deallocate network for instance.
Nov 28 14:39:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-6b41adce-4bc3-459e-b2d1-68ceeedf0836 req-b9f6d059-cdb5-4dc3-9860-22a2b82741b4 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-deleted-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] Acquiring lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG nova.compute.manager [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] No waiting events found dispatching network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:39:51 user nova-compute[75453]: WARNING nova.compute.manager [req-daf42d20-61fa-46f3-9a4c-a77627bf6282 req-ef874ee4-b103-4508-b8c8-68ba5cd9b4f1 service nova] [instance: e1c46e9d-f04c-4e5f-975e-cf191849d243] Received unexpected event network-vif-plugged-9b815f80-08ff-4406-840c-b2152652eea6 for instance with vm_state deleted and task_state None.
Nov 28 14:39:51 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:39:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:39:51 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Deleted allocations for instance e1c46e9d-f04c-4e5f-975e-cf191849d243
Nov 28 14:39:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-fcce110e-6cfc-42ab-9e0c-38229c1f8340 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "e1c46e9d-f04c-4e5f-975e-cf191849d243" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.734s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:39:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:39:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:40:04 user nova-compute[75453]: INFO nova.compute.claims [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Claim successful on node user
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.network.neutron [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:40:04 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.policy [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4c1c7c913b841ab85f8615bc9f8fc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e256bfa6e74f7bbd126a9fd943644d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:40:04 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Creating image(s)
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "/opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "/opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "/opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:04 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk 1073741824" returned: 0 in 0.054s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Successfully created port: 9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.184s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Cannot resize image /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Ensure instance console log exists: /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Successfully updated port: 9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquired lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received event network-changed-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.compute.manager [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Refreshing instance network info cache due to event network-changed-9659cf88-5aba-4655-ab65-0dbc2163dc2a. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] Acquiring lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating instance_info_cache with network_info: [{"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Releasing lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Instance network_info: |[{"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] Acquired lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Refreshing network info cache for port 9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Start _get_guest_xml network_info=[{"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:40:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:40:06 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-970246909',display_name='tempest-SnapshotDataIntegrityTests-server-970246909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-970246909',id=45,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBaKb7rg6g18x4j0eX1QsE3yUrnfWe74mIrqrgLURwj6/hcCtSxFbZTDVQGURU3/kHArSgm8BsUBT8Ti0m+d6rAKAIHzukl416ZdeeOkKnesdNlp7zR6Oa/aR2XNNr1/w==',key_name='tempest-keypair-1040277365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1e256bfa6e74f7bbd126a9fd943644d',ramdisk_id='',reservation_id='r-delz6xqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1639319271',owner_user_name='tempest-SnapshotDataIntegrityTests-1639319271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:40:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4c1c7c913b841ab85f8615bc9f8fc04',uuid=da6e174b-68e8-413f-adc7-27c899ad004c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Converting VIF {"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fa:10,bridge_name='br-int',has_traffic_filtering=True,id=9659cf88-5aba-4655-ab65-0dbc2163dc2a,network=Network(c4f5d8c6-5294-4666-a5ad-5359bd17d219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9659cf88-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.objects.instance [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'pci_devices' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:40:06 user nova-compute[75453]:   <uuid>da6e174b-68e8-413f-adc7-27c899ad004c</uuid>
Nov 28 14:40:06 user nova-compute[75453]:   <name>instance-0000002d</name>
Nov 28 14:40:06 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:40:06 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:40:06 user nova-compute[75453]:   <metadata>
Nov 28 14:40:06 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:40:06 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:40:06 user nova-compute[75453]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-970246909</nova:name>
Nov 28 14:40:06 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:40:06</nova:creationTime>
Nov 28 14:40:06 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:40:06 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:40:06 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:40:06 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:40:06 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:40:06 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:40:06 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:40:06 user nova-compute[75453]:       <nova:owner>
Nov 28 14:40:06 user nova-compute[75453]:         <nova:user uuid="a4c1c7c913b841ab85f8615bc9f8fc04">tempest-SnapshotDataIntegrityTests-1639319271-project-member</nova:user>
Nov 28 14:40:06 user nova-compute[75453]:         <nova:project uuid="b1e256bfa6e74f7bbd126a9fd943644d">tempest-SnapshotDataIntegrityTests-1639319271</nova:project>
Nov 28 14:40:06 user nova-compute[75453]:       </nova:owner>
Nov 28 14:40:06 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:40:06 user nova-compute[75453]:       <nova:ports>
Nov 28 14:40:06 user nova-compute[75453]:         <nova:port uuid="9659cf88-5aba-4655-ab65-0dbc2163dc2a">
Nov 28 14:40:06 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 14:40:06 user nova-compute[75453]:         </nova:port>
Nov 28 14:40:06 user nova-compute[75453]:       </nova:ports>
Nov 28 14:40:06 user nova-compute[75453]:     </nova:instance>
Nov 28 14:40:06 user nova-compute[75453]:   </metadata>
Nov 28 14:40:06 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:40:06 user nova-compute[75453]:     <system>
Nov 28 14:40:06 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:40:06 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:40:06 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:40:06 user nova-compute[75453]:       <entry name="serial">da6e174b-68e8-413f-adc7-27c899ad004c</entry>
Nov 28 14:40:06 user nova-compute[75453]:       <entry name="uuid">da6e174b-68e8-413f-adc7-27c899ad004c</entry>
Nov 28 14:40:06 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:40:06 user nova-compute[75453]:     </system>
Nov 28 14:40:06 user nova-compute[75453]:   </sysinfo>
Nov 28 14:40:06 user nova-compute[75453]:   <os>
Nov 28 14:40:06 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:40:06 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:40:06 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:40:06 user nova-compute[75453]:   </os>
Nov 28 14:40:06 user nova-compute[75453]:   <features>
Nov 28 14:40:06 user nova-compute[75453]:     <acpi/>
Nov 28 14:40:06 user nova-compute[75453]:     <apic/>
Nov 28 14:40:06 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:40:06 user nova-compute[75453]:   </features>
Nov 28 14:40:06 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:40:06 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:40:06 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:40:06 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:40:06 user nova-compute[75453]:   </clock>
Nov 28 14:40:06 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:40:06 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:40:06 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:40:06 user nova-compute[75453]:   </cpu>
Nov 28 14:40:06 user nova-compute[75453]:   <devices>
Nov 28 14:40:06 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:40:06 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:40:06 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk"/>
Nov 28 14:40:06 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:40:06 user nova-compute[75453]:     </disk>
Nov 28 14:40:06 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:40:06 user nova-compute[75453]:       <mac address="fa:16:3e:7c:fa:10"/>
Nov 28 14:40:06 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:40:06 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:40:06 user nova-compute[75453]:       <target dev="tap9659cf88-5a"/>
Nov 28 14:40:06 user nova-compute[75453]:     </interface>
Nov 28 14:40:06 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:40:06 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/console.log" append="off"/>
Nov 28 14:40:06 user nova-compute[75453]:     </serial>
Nov 28 14:40:06 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:40:06 user nova-compute[75453]:     <video>
Nov 28 14:40:06 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:40:06 user nova-compute[75453]:     </video>
Nov 28 14:40:06 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:40:06 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:40:06 user nova-compute[75453]:     </rng>
Nov 28 14:40:06 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:40:06 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:40:06 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:40:06 user nova-compute[75453]:     </memballoon>
Nov 28 14:40:06 user nova-compute[75453]:   </devices>
Nov 28 14:40:06 user nova-compute[75453]: </domain>
Nov 28 14:40:06 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-970246909',display_name='tempest-SnapshotDataIntegrityTests-server-970246909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-970246909',id=45,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBaKb7rg6g18x4j0eX1QsE3yUrnfWe74mIrqrgLURwj6/hcCtSxFbZTDVQGURU3/kHArSgm8BsUBT8Ti0m+d6rAKAIHzukl416ZdeeOkKnesdNlp7zR6Oa/aR2XNNr1/w==',key_name='tempest-keypair-1040277365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1e256bfa6e74f7bbd126a9fd943644d',ramdisk_id='',reservation_id='r-delz6xqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1639319271',owner_user_name='tempest-SnapshotDataIntegrityTests-1639319271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:40:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4c1c7c913b841ab85f8615bc9f8fc04',uuid=da6e174b-68e8-413f-adc7-27c899ad004c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Converting VIF {"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fa:10,bridge_name='br-int',has_traffic_filtering=True,id=9659cf88-5aba-4655-ab65-0dbc2163dc2a,network=Network(c4f5d8c6-5294-4666-a5ad-5359bd17d219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9659cf88-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG os_vif [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fa:10,bridge_name='br-int',has_traffic_filtering=True,id=9659cf88-5aba-4655-ab65-0dbc2163dc2a,network=Network(c4f5d8c6-5294-4666-a5ad-5359bd17d219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9659cf88-5a') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '605d9e88-4277-5b68-9bae-60221620aefe', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9659cf88-5a, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9659cf88-5a, col_values=(('qos', UUID('2e89ad77-92be-4c81-a406-c72ed3f0d684')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9659cf88-5a, col_values=(('external_ids', {'iface-id': '9659cf88-5aba-4655-ab65-0dbc2163dc2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:fa:10', 'vm-uuid': 'da6e174b-68e8-413f-adc7-27c899ad004c'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:06 user nova-compute[75453]: INFO os_vif [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fa:10,bridge_name='br-int',has_traffic_filtering=True,id=9659cf88-5aba-4655-ab65-0dbc2163dc2a,network=Network(c4f5d8c6-5294-4666-a5ad-5359bd17d219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9659cf88-5a')
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No VIF found with MAC fa:16:3e:7c:fa:10, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updated VIF entry in instance network info cache for port 9659cf88-5aba-4655-ab65-0dbc2163dc2a. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG nova.network.neutron [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating instance_info_cache with network_info: [{"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:40:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-febf71b4-5900-42b9-ab63-3eeca9966670 req-5df986c9-4001-463b-a216-b268c9cff90b service nova] Releasing lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:40:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received event network-vif-plugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:40:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:08 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:08 user nova-compute[75453]: DEBUG nova.compute.manager [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] No waiting events found dispatching network-vif-plugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:40:08 user nova-compute[75453]: WARNING nova.compute.manager [req-e535db64-8a1b-4db7-b185-06782b37072f req-71202d79-0a95-4d76-80cb-e13a5729a2b3 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received unexpected event network-vif-plugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance with vm_state building and task_state spawning.
Nov 28 14:40:08 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:40:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Instance spawned successfully.
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received event network-vif-plugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.compute.manager [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] No waiting events found dispatching network-vif-plugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:40:10 user nova-compute[75453]: WARNING nova.compute.manager [req-f4505730-18a0-4eed-8287-fc8bfbad1acb req-c4a67363-0dfb-45bb-aa09-f4b578490dc6 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received unexpected event network-vif-plugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance with vm_state building and task_state spawning.
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:40:10 user nova-compute[75453]: INFO nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 28 14:40:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:40:10 user nova-compute[75453]: INFO nova.compute.manager [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Took 5.98 seconds to build instance.
Nov 28 14:40:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-feb5381b-3d0c-4c94-bf03-5b049a285702 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.071s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:40:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:40:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:40:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:40:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:34 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:38 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:40:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:40:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:40:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=24.982948303222656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance b1db2136-7fba-4701-bbc0-afee6b009a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance da6e174b-68e8-413f-adc7-27c899ad004c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:40:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:42 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:40:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:46 user nova-compute[75453]: INFO nova.compute.manager [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Terminating instance
Nov 28 14:40:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-unplugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] No waiting events found dispatching network-vif-unplugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG nova.compute.manager [req-af4ca496-4f0d-4f23-927a-a6530b9d2f8b req-694be134-9241-423b-a569-643bce7c774c service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-unplugged-13b2b5c8-da0f-4c65-a267-199ae324844d for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Instance destroyed successfully.
Nov 28 14:40:47 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'resources' on Instance uuid b1db2136-7fba-4701-bbc0-afee6b009a3c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1897090922',display_name='tempest-ServerRescueNegativeTestJSON-server-1897090922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1897090922',id=41,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:26:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-0rftpo3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:26:40Z,user_data=None,user_id='7ac79717e12544d39215874f9b99ccf2',uuid=b1db2136-7fba-4701-bbc0-afee6b009a3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "13b2b5c8-da0f-4c65-a267-199ae324844d", "address": "fa:16:3e:6b:77:44", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b2b5c8-da", "ovs_interfaceid": "13b2b5c8-da0f-4c65-a267-199ae324844d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:77:44,bridge_name='br-int',has_traffic_filtering=True,id=13b2b5c8-da0f-4c65-a267-199ae324844d,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b2b5c8-da') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG os_vif [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:77:44,bridge_name='br-int',has_traffic_filtering=True,id=13b2b5c8-da0f-4c65-a267-199ae324844d,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b2b5c8-da') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13b2b5c8-da, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88333b8d-26ea-4ee2-8bd2-5c8e08e0cf65) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:40:47 user nova-compute[75453]: INFO os_vif [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:77:44,bridge_name='br-int',has_traffic_filtering=True,id=13b2b5c8-da0f-4c65-a267-199ae324844d,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b2b5c8-da')
Nov 28 14:40:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Deleting instance files /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c_del
Nov 28 14:40:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Deletion of /opt/stack/data/nova/instances/b1db2136-7fba-4701-bbc0-afee6b009a3c_del complete
Nov 28 14:40:47 user nova-compute[75453]: INFO nova.compute.manager [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 28 14:40:47 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:48 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:40:48 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Took 0.51 seconds to deallocate network for instance.
Nov 28 14:40:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:48 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:40:48 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:40:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:48 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Deleted allocations for instance b1db2136-7fba-4701-bbc0-afee6b009a3c
Nov 28 14:40:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c2b0d242-864d-42ee-a81b-2150fad58ef3 tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.800s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:40:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] Acquiring lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:40:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:40:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] Lock "b1db2136-7fba-4701-bbc0-afee6b009a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:40:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] No waiting events found dispatching network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:40:49 user nova-compute[75453]: WARNING nova.compute.manager [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received unexpected event network-vif-plugged-13b2b5c8-da0f-4c65-a267-199ae324844d for instance with vm_state deleted and task_state None.
Nov 28 14:40:49 user nova-compute[75453]: DEBUG nova.compute.manager [req-e42ffa2c-83c3-4715-9c3d-fd22b85c5e9a req-0cb07710-e801-4747-b3af-d5175cb689ec service nova] [instance: b1db2136-7fba-4701-bbc0-afee6b009a3c] Received event network-vif-deleted-13b2b5c8-da0f-4c65-a267-199ae324844d {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:40:49 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:40:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:40:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:40:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:40:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:40:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:40:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:36 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:37 user nova-compute[75453]: INFO nova.compute.manager [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Terminating instance
Nov 28 14:41:37 user nova-compute[75453]: DEBUG nova.compute.manager [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG nova.compute.manager [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG nova.compute.manager [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG nova.compute.manager [req-e33ae0e2-4364-4f4d-86a9-dc37700c9cdc req-33c2e80d-c2f6-41cd-b860-8ac3b564889d service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:41:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Instance destroyed successfully.
Nov 28 14:41:38 user nova-compute[75453]: DEBUG nova.objects.instance [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lazy-loading 'resources' on Instance uuid 23f4cfb9-18d6-419b-9fb0-23a0da9da00f {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1751051532',display_name='tempest-ServerRescueNegativeTestJSON-server-1751051532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1751051532',id=40,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:29:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c90c4a02d30c48c7b6ee993b9b213c2b',ramdisk_id='',reservation_id='r-o8acmmwh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1690568266',owner_user_name='tempest-ServerRescueNegativeTestJSON-1690568266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:31:23Z,user_data=None,user_id='7ac79717e12544d39215874f9b99ccf2',uuid=23f4cfb9-18d6-419b-9fb0-23a0da9da00f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converting VIF {"id": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "address": "fa:16:3e:61:f4:fe", "network": {"id": "e1730cd2-e937-4650-bb09-73cc1ca30994", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1793238878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c90c4a02d30c48c7b6ee993b9b213c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3690b5db-09", "ovs_interfaceid": "3690b5db-09a7-4666-acc2-ef6d7d0ce3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:f4:fe,bridge_name='br-int',has_traffic_filtering=True,id=3690b5db-09a7-4666-acc2-ef6d7d0ce3ed,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3690b5db-09') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG os_vif [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:f4:fe,bridge_name='br-int',has_traffic_filtering=True,id=3690b5db-09a7-4666-acc2-ef6d7d0ce3ed,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3690b5db-09') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3690b5db-09, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1ba90ed-3ff6-42e5-8082-78a6d083e428) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:38 user nova-compute[75453]: INFO os_vif [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:f4:fe,bridge_name='br-int',has_traffic_filtering=True,id=3690b5db-09a7-4666-acc2-ef6d7d0ce3ed,network=Network(e1730cd2-e937-4650-bb09-73cc1ca30994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3690b5db-09')
Nov 28 14:41:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Deleting instance files /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f_del
Nov 28 14:41:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Deletion of /opt/stack/data/nova/instances/23f4cfb9-18d6-419b-9fb0-23a0da9da00f_del complete
Nov 28 14:41:38 user nova-compute[75453]: INFO nova.compute.manager [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 14:41:38 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Took 0.51 seconds to deallocate network for instance.
Nov 28 14:41:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-24d11cdd-6d86-4aa3-84ac-ecc9893082d0 req-be70f143-dd46-4c0b-a1d2-711e39ef183b service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-deleted-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:39 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Deleted allocations for instance 23f4cfb9-18d6-419b-9fb0-23a0da9da00f
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-cbde3536-ae5d-444e-b7ec-403ed461f1ab tempest-ServerRescueNegativeTestJSON-1690568266 tempest-ServerRescueNegativeTestJSON-1690568266-project-member] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.781s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:41:39 user nova-compute[75453]: WARNING nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state deleted and task_state None.
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:41:39 user nova-compute[75453]: WARNING nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state deleted and task_state None.
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:41:39 user nova-compute[75453]: WARNING nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state deleted and task_state None.
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:41:39 user nova-compute[75453]: WARNING nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-unplugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state deleted and task_state None.
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Acquiring lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] Lock "23f4cfb9-18d6-419b-9fb0-23a0da9da00f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:39 user nova-compute[75453]: DEBUG nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] No waiting events found dispatching network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:41:39 user nova-compute[75453]: WARNING nova.compute.manager [req-a833938b-b5cc-49b3-96da-ffd295a4cb6d req-9cf9a74f-ba48-4e1a-b270-9651c5ccedf0 service nova] [instance: 23f4cfb9-18d6-419b-9fb0-23a0da9da00f] Received unexpected event network-vif-plugged-3690b5db-09a7-4666-acc2-ef6d7d0ce3ed for instance with vm_state deleted and task_state None.
Nov 28 14:41:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:41:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:41:40 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=25.03045654296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance da6e174b-68e8-413f-adc7-27c899ad004c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:41:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:41:44 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:41:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:41:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:41:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:41:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:41:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:41:45 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:41:46 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating instance_info_cache with network_info: [{"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:41:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:41:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:41:47 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:47 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:41:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:41:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:41:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:41:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:49 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:41:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:41:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:41:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received event network-changed-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:41:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Refreshing instance network info cache due to event network-changed-9659cf88-5aba-4655-ab65-0dbc2163dc2a. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:41:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] Acquiring lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:41:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] Acquired lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:41:54 user nova-compute[75453]: DEBUG nova.network.neutron [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Refreshing network info cache for port 9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:41:55 user nova-compute[75453]: DEBUG nova.network.neutron [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updated VIF entry in instance network info cache for port 9659cf88-5aba-4655-ab65-0dbc2163dc2a. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:41:55 user nova-compute[75453]: DEBUG nova.network.neutron [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating instance_info_cache with network_info: [{"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:41:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-66c83246-462e-4842-9702-f9c6ee14908e req-65d57426-b5df-4755-b0f6-822dbcab0ec8 service nova] Releasing lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:41:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:41:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:41:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:41:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG nova.objects.instance [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:41:59 user nova-compute[75453]: INFO nova.compute.manager [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attaching volume de2c059a-e1f7-43bd-b107-0c0314f358d2 to /dev/vdb
Nov 28 14:41:59 user nova-compute[75453]: DEBUG os_brick.utils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ecf38c-10f3-4ed9-b25b-06dc33413956]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd273451-5b8a-4dba-b34d-d8e79b4a4108]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c112d6-1c8b-4eda-b366-3cd61628c772]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0921b02a-da9a-4130-8290-3f1c635dff24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:41:59 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:41:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f942904c-2f55-4d90-8043-b63d20dc3fbb]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG os_brick.utils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:41:59 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating existing volume attachment record: bf5e5fb6-c2a8-4e5e-bf67-f3e58cdf5ef1 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:42:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIbZrYEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:42:08 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:42:08 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:42:08 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b005cde0-21f8-448a-bab8-34b1dc49e268]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:42:08 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cee5755-0724-4409-9183-6a89678ea88a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2] added
Nov 28 14:42:08 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3aa404-2790-453e-9395-f7a15722f2a4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b030120-9fc0-43c8-89d6-09593f23eeee]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIbZrYEQ {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIbZrYEQ" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[47acfd9b-4f84-4bdb-b9f4-e255a3e519d8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pIbZrYEQ'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90e7dee-9197-4fa7-88a7-551fff16b029]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf38ca2-3ce3-40c7-8b38-9c932ad17360]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:42:08 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:42:08 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:42:08 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:42:08 user nova-compute[75453]: 
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db7bc5-3090-47a7-8643-68d36a42cfc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2, portal: 172.16.0.220,3260]
Nov 28 14:42:08 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2, portal: 172.16.0.220,3260] successful.
Nov 28 14:42:08 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[32043205-4608-44f5-b4cb-e8409d381b06]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfd1910-f5e1-49ca-b7cd-87bea4d566ae]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 (non-flash)
Nov 28 14:42:08 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 (non-flash)
Nov 28 14:42:08 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa610a4-3c1d-4921-8700-cf2ff96c36ea]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:42:08 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIbZrYEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:42:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:42:09 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26332346236393833', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:42:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332346236393833', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:42:09 user nova-compute[75453]: DEBUG nova.objects.instance [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:42:09 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:42:09 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:42:09 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:42:09 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:42:09 user nova-compute[75453]:   <serial>de2c059a-e1f7-43bd-b107-0c0314f358d2</serial>
Nov 28 14:42:09 user nova-compute[75453]: </disk>
Nov 28 14:42:09 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:42:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:42:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:42:10 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No VIF found with MAC fa:16:3e:7c:fa:10, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:42:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9c308773-3d23-4727-8a30-539d1a185133 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.846s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:42:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:42:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:42:24 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:42:24 user nova-compute[75453]: INFO nova.compute.manager [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Detaching volume de2c059a-e1f7-43bd-b107-0c0314f358d2
Nov 28 14:42:24 user nova-compute[75453]: INFO nova.virt.block_device [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attempting to driver detach volume de2c059a-e1f7-43bd-b107-0c0314f358d2 from mountpoint /dev/vdb
Nov 28 14:42:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Attempting to detach device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:42:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:42:24 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:42:24 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:42:24 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:42:24 user nova-compute[75453]:   <serial>de2c059a-e1f7-43bd-b107-0c0314f358d2</serial>
Nov 28 14:42:24 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:42:24 user nova-compute[75453]: </disk>
Nov 28 14:42:24 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:42:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully detached device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the persistent domain config.
Nov 28 14:42:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da6e174b-68e8-413f-adc7-27c899ad004c from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:42:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:42:24 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:42:24 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:42:24 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:42:24 user nova-compute[75453]:   <serial>de2c059a-e1f7-43bd-b107-0c0314f358d2</serial>
Nov 28 14:42:24 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:42:24 user nova-compute[75453]: </disk>
Nov 28 14:42:24 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:42:25 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:42:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:29 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_power_states {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:29 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:42:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:42:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:42:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:42:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:42:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:42:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:38 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:38 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:42:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:42:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:42:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:42:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:41 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:42:41 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:42:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.028697967529297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:42:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:42:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:42:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance da6e174b-68e8-413f-adc7-27c899ad004c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:42:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:42:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:42:41 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:42:41 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:42:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:42:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:42:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:42:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:42:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:42:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:42:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:45 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da6e174b-68e8-413f-adc7-27c899ad004c is timed out.
Nov 28 14:42:45 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully detached device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the live domain config.
Nov 28 14:42:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIbZrYEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:42:45 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[96078154-e779-4c08-9b8f-d0c38850f3ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:42:45 user nova-compute[75453]: No targets found.
Nov 28 14:42:45 user nova-compute[75453]: iSNS:
Nov 28 14:42:45 user nova-compute[75453]: No targets found.
Nov 28 14:42:45 user nova-compute[75453]: STATIC:
Nov 28 14:42:45 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2
Nov 28 14:42:45 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:42:45 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:42:45 user nova-compute[75453]: FIRMWARE:
Nov 28 14:42:45 user nova-compute[75453]: No targets found.
Nov 28 14:42:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:42:45 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:42:45 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcefcd63-12ba-47fb-8bda-7328c6b53533]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b76e511-cc34-4bcc-b5ca-7a0a9d9f62b9]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 (non-flash)
Nov 28 14:42:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 (non-flash)
Nov 28 14:42:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c724310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b7be4-d7fb-486f-8aed-fe4ebc14dac1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f3075-51c0-466b-a2b6-6c35119a2130]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[664d967b-e020-4f8f-9c76-40587164015b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ade8563-1f39-4a60-8c3c-33d3c8b40ea6]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0825898d-c036-444c-9827-33414ad0aef8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ac5978-3401-495d-96e6-cce9681a2850]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2, portal: 172.16.0.220,3260]
Nov 28 14:42:45 user nova-compute[75453]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2, portal: 172.16.0.220,3260] successful.
Nov 28 14:42:45 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de2c059a-e1f7-43bd-b107-0c0314f358d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aded125-c2d6-4022-a37b-0c9a1b5de0b3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== disconnect_volume: return (302ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:42:45 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG nova.objects.instance [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-40a5b4a5-311e-4805-a5b9-ab1b56e598f1 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.852s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.561s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:42:46 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating instance_info_cache with network_info: [{"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:42:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:42:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:42:47 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:42:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:42:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:42:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:42:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:42:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:52 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:42:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:42:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:42:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:42:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:42:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:42:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:42:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:43:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:43:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:43:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:43:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:43:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:43:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:43:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:43:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:43:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:43:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:43:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:43:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:43:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:17 user nova-compute[75453]: DEBUG nova.objects.instance [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:43:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:17 user nova-compute[75453]: INFO nova.compute.manager [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attaching volume af91e531-32c4-42e0-8e83-3f008081bda4 to /dev/vdb
Nov 28 14:43:18 user nova-compute[75453]: DEBUG os_brick.utils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b34728d-6cf1-4576-b8ba-de5bad418639]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b13dc5-aa24-4656-b5f7-b5990d12de9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4500cb65-ec27-45aa-8288-b2da7e73341b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af3dd91-f388-4a7b-9256-43bae8ea3732]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:43:18 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:43:18 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d6796-9fa3-4be1-b7c4-a2340048d228]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG os_brick.utils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating existing volume attachment record: 0e433595-797e-46cf-8d3c-309291d85ecb {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:43:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTGtubnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:43:24 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:43:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:43:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:43:24 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:43:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:43:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:43:24 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:43:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:24 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b4033-fb4d-4d46-8128-ac5a2cd98e56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:24 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:43:24 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:24 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[890bbd3f-2454-4db3-97b4-d7a348643acb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4] added
Nov 28 14:43:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea1df27-63ee-4064-a2fb-faa52fe82be8]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[377e625c-3073-4253-8f17-9c70a31ad309]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jTGtubnB {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jTGtubnB" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dae7be3-6af1-4d9a-9243-1a7e5e15bd83]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jTGtubnB'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c0cbd-9626-420f-8cdc-9242d877b23d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684828f-5da2-4752-bb24-b2cb21d13bd8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:43:25 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:43:25 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:43:25 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:43:25 user nova-compute[75453]: 
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae9f2f-a31d-4d73-996a-7182cc288683]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4, portal: 172.16.0.220,3260]
Nov 28 14:43:25 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4, portal: 172.16.0.220,3260] successful.
Nov 28 14:43:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9fb163-32d2-4552-b09e-1fabebea6d19]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[33debc52-79fc-42e6-b92d-2d5a6252dd2d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 (non-flash)
Nov 28 14:43:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 (non-flash)
Nov 28 14:43:25 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae68f15-b3f6-453a-a69a-e3a5214fde61]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTGtubnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:43:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:43:26 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26334646564363333', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:43:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334646564363333', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:43:26 user nova-compute[75453]: DEBUG nova.objects.instance [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:43:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:43:26 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:43:26 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:43:26 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:43:26 user nova-compute[75453]:   <serial>af91e531-32c4-42e0-8e83-3f008081bda4</serial>
Nov 28 14:43:26 user nova-compute[75453]: </disk>
Nov 28 14:43:26 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:43:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:43:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:43:26 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No VIF found with MAC fa:16:3e:7c:fa:10, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:43:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-13561ba7-72e9-4e78-b501-1a76638c7dbd tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.849s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:43:28 user nova-compute[75453]: INFO nova.compute.claims [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Claim successful on node user
Nov 28 14:43:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:43:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:43:28 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.policy [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61811e8f2c74409c86b108ac9c7647e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5869d755289842bf9d1e4006eed3ad7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:43:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Creating image(s)
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "/opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "/opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.192s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:29 user nova-compute[75453]: INFO nova.compute.manager [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Detaching volume af91e531-32c4-42e0-8e83-3f008081bda4
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk 1073741824 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:29 user nova-compute[75453]: INFO nova.virt.block_device [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attempting to driver detach volume af91e531-32c4-42e0-8e83-3f008081bda4 from mountpoint /dev/vdb
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d,backing_fmt=raw /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk 1073741824" returned: 0 in 0.072s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Attempting to detach device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:43:29 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:43:29 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:43:29 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:43:29 user nova-compute[75453]:   <serial>af91e531-32c4-42e0-8e83-3f008081bda4</serial>
Nov 28 14:43:29 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:43:29 user nova-compute[75453]: </disk>
Nov 28 14:43:29 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:43:29 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully detached device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the persistent domain config.
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da6e174b-68e8-413f-adc7-27c899ad004c from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:43:29 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:43:29 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:43:29 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:43:29 user nova-compute[75453]:   <serial>af91e531-32c4-42e0-8e83-3f008081bda4</serial>
Nov 28 14:43:29 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:43:29 user nova-compute[75453]: </disk>
Nov 28 14:43:29 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Successfully created port: 4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38fd10668bc7e9ec4e3685afcca5024c9b0e8b9d --force-share --output=json" returned: 0 in 0.168s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk. size=1073741824 {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.virt.disk.api [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Cannot resize image /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk to a smaller size. {{(pid=75453) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Created local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Ensure instance console log exists: /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Successfully updated port: 4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquired lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received event network-changed-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.compute.manager [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Refreshing instance network info cache due to event network-changed-4b6f3d19-5c51-46b3-9f2c-5171434afd99. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] Acquiring lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.network.neutron [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Updating instance_info_cache with network_info: [{"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Releasing lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Instance network_info: |[{"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] Acquired lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.network.neutron [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Refreshing network info cache for port 4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Start _get_guest_xml network_info=[{"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'image_id': '0d03e2fc-4d16-4fd7-9616-933da07dcf7b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:43:30 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:43:30 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T13:51:26Z,direct_url=<?>,disk_format='qcow2',id=0d03e2fc-4d16-4fd7-9616-933da07dcf7b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='55c8b5e4f96f44279c991fc8a3754674',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T13:51:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826881',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1057826',id=46,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHHW6xOOkXA6HO6AyAtKqVaWqyVEs+REq4AOqAeGr8O/kcUci05pEH4UptKQ7ADA4MvvQJQ9S1flPRz4ednzYhnCvycjaMwmgIoVO324NA/FvuJTcVVlJCZ83QkrfxBTA==',key_name='tempest-keypair-1925480414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5869d755289842bf9d1e4006eed3ad7e',ramdisk_id='',reservation_id='r-wbh72s0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-172678324',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:43:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61811e8f2c74409c86b108ac9c7647e2',uuid=a9194d1d-5b78-47e2-9a7d-7c7adf178bbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Converting VIF {"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:2c:50,bridge_name='br-int',has_traffic_filtering=True,id=4b6f3d19-5c51-46b3-9f2c-5171434afd99,network=Network(f13184a0-39de-4810-a596-b27f7cd0bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6f3d19-5c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lazy-loading 'pci_devices' on Instance uuid a9194d1d-5b78-47e2-9a7d-7c7adf178bbb {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:43:30 user nova-compute[75453]:   <uuid>a9194d1d-5b78-47e2-9a7d-7c7adf178bbb</uuid>
Nov 28 14:43:30 user nova-compute[75453]:   <name>instance-0000002e</name>
Nov 28 14:43:30 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:43:30 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:43:30 user nova-compute[75453]:   <metadata>
Nov 28 14:43:30 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:43:30 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:43:30 user nova-compute[75453]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826881</nova:name>
Nov 28 14:43:30 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:43:30</nova:creationTime>
Nov 28 14:43:30 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:43:30 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:43:30 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:43:30 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:43:30 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:43:30 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:43:30 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:43:30 user nova-compute[75453]:       <nova:owner>
Nov 28 14:43:30 user nova-compute[75453]:         <nova:user uuid="61811e8f2c74409c86b108ac9c7647e2">tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member</nova:user>
Nov 28 14:43:30 user nova-compute[75453]:         <nova:project uuid="5869d755289842bf9d1e4006eed3ad7e">tempest-TestServerVolumeAttachScenarioOldVersion-172678324</nova:project>
Nov 28 14:43:30 user nova-compute[75453]:       </nova:owner>
Nov 28 14:43:30 user nova-compute[75453]:       <nova:root type="image" uuid="0d03e2fc-4d16-4fd7-9616-933da07dcf7b"/>
Nov 28 14:43:30 user nova-compute[75453]:       <nova:ports>
Nov 28 14:43:30 user nova-compute[75453]:         <nova:port uuid="4b6f3d19-5c51-46b3-9f2c-5171434afd99">
Nov 28 14:43:30 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 14:43:30 user nova-compute[75453]:         </nova:port>
Nov 28 14:43:30 user nova-compute[75453]:       </nova:ports>
Nov 28 14:43:30 user nova-compute[75453]:     </nova:instance>
Nov 28 14:43:30 user nova-compute[75453]:   </metadata>
Nov 28 14:43:30 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:43:30 user nova-compute[75453]:     <system>
Nov 28 14:43:30 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:43:30 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:43:30 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:43:30 user nova-compute[75453]:       <entry name="serial">a9194d1d-5b78-47e2-9a7d-7c7adf178bbb</entry>
Nov 28 14:43:30 user nova-compute[75453]:       <entry name="uuid">a9194d1d-5b78-47e2-9a7d-7c7adf178bbb</entry>
Nov 28 14:43:30 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:43:30 user nova-compute[75453]:     </system>
Nov 28 14:43:30 user nova-compute[75453]:   </sysinfo>
Nov 28 14:43:30 user nova-compute[75453]:   <os>
Nov 28 14:43:30 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:43:30 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:43:30 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:43:30 user nova-compute[75453]:   </os>
Nov 28 14:43:30 user nova-compute[75453]:   <features>
Nov 28 14:43:30 user nova-compute[75453]:     <acpi/>
Nov 28 14:43:30 user nova-compute[75453]:     <apic/>
Nov 28 14:43:30 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:43:30 user nova-compute[75453]:   </features>
Nov 28 14:43:30 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:43:30 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:43:30 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:43:30 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:43:30 user nova-compute[75453]:   </clock>
Nov 28 14:43:30 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:43:30 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:43:30 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:43:30 user nova-compute[75453]:   </cpu>
Nov 28 14:43:30 user nova-compute[75453]:   <devices>
Nov 28 14:43:30 user nova-compute[75453]:     <disk type="file" device="disk">
Nov 28 14:43:30 user nova-compute[75453]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 14:43:30 user nova-compute[75453]:       <source file="/opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk"/>
Nov 28 14:43:30 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:43:30 user nova-compute[75453]:     </disk>
Nov 28 14:43:30 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:43:30 user nova-compute[75453]:       <mac address="fa:16:3e:7d:2c:50"/>
Nov 28 14:43:30 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:43:30 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:43:30 user nova-compute[75453]:       <target dev="tap4b6f3d19-5c"/>
Nov 28 14:43:30 user nova-compute[75453]:     </interface>
Nov 28 14:43:30 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:43:30 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/console.log" append="off"/>
Nov 28 14:43:30 user nova-compute[75453]:     </serial>
Nov 28 14:43:30 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:43:30 user nova-compute[75453]:     <video>
Nov 28 14:43:30 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:43:30 user nova-compute[75453]:     </video>
Nov 28 14:43:30 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:43:30 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:43:30 user nova-compute[75453]:     </rng>
Nov 28 14:43:30 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:43:30 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:43:30 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:43:30 user nova-compute[75453]:     </memballoon>
Nov 28 14:43:30 user nova-compute[75453]:   </devices>
Nov 28 14:43:30 user nova-compute[75453]: </domain>
Nov 28 14:43:30 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826881',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1057826',id=46,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHHW6xOOkXA6HO6AyAtKqVaWqyVEs+REq4AOqAeGr8O/kcUci05pEH4UptKQ7ADA4MvvQJQ9S1flPRz4ednzYhnCvycjaMwmgIoVO324NA/FvuJTcVVlJCZ83QkrfxBTA==',key_name='tempest-keypair-1925480414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5869d755289842bf9d1e4006eed3ad7e',ramdisk_id='',reservation_id='r-wbh72s0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-172678324',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:43:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61811e8f2c74409c86b108ac9c7647e2',uuid=a9194d1d-5b78-47e2-9a7d-7c7adf178bbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Converting VIF {"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:2c:50,bridge_name='br-int',has_traffic_filtering=True,id=4b6f3d19-5c51-46b3-9f2c-5171434afd99,network=Network(f13184a0-39de-4810-a596-b27f7cd0bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6f3d19-5c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG os_vif [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:2c:50,bridge_name='br-int',has_traffic_filtering=True,id=4b6f3d19-5c51-46b3-9f2c-5171434afd99,network=Network(f13184a0-39de-4810-a596-b27f7cd0bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6f3d19-5c') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20889eea-d878-515d-9ac3-aad9ef38bc64', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b6f3d19-5c, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b6f3d19-5c, col_values=(('qos', UUID('6ba4a90e-7eb4-4375-a96b-ea4cd3791d42')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b6f3d19-5c, col_values=(('external_ids', {'iface-id': '4b6f3d19-5c51-46b3-9f2c-5171434afd99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:2c:50', 'vm-uuid': 'a9194d1d-5b78-47e2-9a7d-7c7adf178bbb'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:30 user nova-compute[75453]: INFO os_vif [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:2c:50,bridge_name='br-int',has_traffic_filtering=True,id=4b6f3d19-5c51-46b3-9f2c-5171434afd99,network=Network(f13184a0-39de-4810-a596-b27f7cd0bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6f3d19-5c')
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:43:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] No VIF found with MAC fa:16:3e:7d:2c:50, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:43:31 user nova-compute[75453]: DEBUG nova.network.neutron [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Updated VIF entry in instance network info cache for port 4b6f3d19-5c51-46b3-9f2c-5171434afd99. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:43:31 user nova-compute[75453]: DEBUG nova.network.neutron [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Updating instance_info_cache with network_info: [{"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:43:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2701952e-5390-42bb-976e-8fa8fc5d4cb4 req-9dbd1907-a55f-4ff4-b4c5-a25c66912a60 service nova] Releasing lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received event network-vif-plugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] No waiting events found dispatching network-vif-plugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:43:32 user nova-compute[75453]: WARNING nova.compute.manager [req-9d7a1625-5f59-40ec-a491-64c8f021dd46 req-e9ab08a7-4c1c-4477-8b55-343428e16ad4 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received unexpected event network-vif-plugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance with vm_state building and task_state spawning.
Nov 28 14:43:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:43:34 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Instance spawned successfully.
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:43:34 user nova-compute[75453]: INFO nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received event network-vif-plugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] No waiting events found dispatching network-vif-plugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:43:34 user nova-compute[75453]: WARNING nova.compute.manager [req-baca341a-4c3e-4efa-861d-da4968de0f26 req-52416d13-2c3c-4b9f-ac0a-0300031853b2 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received unexpected event network-vif-plugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance with vm_state building and task_state spawning.
Nov 28 14:43:34 user nova-compute[75453]: INFO nova.compute.manager [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Took 5.95 seconds to build instance.
Nov 28 14:43:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c3c94ed8-0140-459b-a26e-62633ac587e4 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.061s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:38 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:43:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:39 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:40 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:41 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:43:41 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:43:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.01715850830078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance da6e174b-68e8-413f-adc7-27c899ad004c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:43:41 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:43:42 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:43:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:43:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:43:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:43:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:43:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:43:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:43:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:43:48 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:43:48 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:43:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:49 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating instance_info_cache with network_info: [{"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:43:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:43:49 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:43:49 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:43:49 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:43:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da6e174b-68e8-413f-adc7-27c899ad004c is timed out.
Nov 28 14:43:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully detached device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the live domain config.
Nov 28 14:43:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTGtubnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:43:50 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[af438667-8858-4e00-99b5-6ec9e3895d23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:43:50 user nova-compute[75453]: No targets found.
Nov 28 14:43:50 user nova-compute[75453]: iSNS:
Nov 28 14:43:50 user nova-compute[75453]: No targets found.
Nov 28 14:43:50 user nova-compute[75453]: STATIC:
Nov 28 14:43:50 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4
Nov 28 14:43:50 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:43:50 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:43:50 user nova-compute[75453]: FIRMWARE:
Nov 28 14:43:50 user nova-compute[75453]: No targets found.
Nov 28 14:43:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:43:50 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:43:50 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaadae3-9549-4f67-9cc0-240c4fc32eec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d80226b-cd71-4168-8f64-70a2a2861772]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 (non-flash)
Nov 28 14:43:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 (non-flash)
Nov 28 14:43:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c7256c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2486b1f5-05a6-4418-940f-7675a48651bb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b22a403-ced7-4453-88f1-29b831b6a741]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab580a70-de25-4b57-b2d4-987d36b6afe2]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[20521f7a-c52e-487f-8d28-af98e5a6fe7f]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[258137cd-b046-4dfa-b745-8296e308eb05]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db79f06-ced4-4e93-964d-cfd0d03b5e43]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4, portal: 172.16.0.220,3260]
Nov 28 14:43:50 user nova-compute[75453]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4, portal: 172.16.0.220,3260] successful.
Nov 28 14:43:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af91e531-32c4-42e0-8e83-3f008081bda4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[674691b8-923e-4287-8571-11da9eb9ad4c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== disconnect_volume: return (267ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:43:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:51 user nova-compute[75453]: DEBUG nova.objects.instance [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:43:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-545ea198-9c0e-43c3-9fbf-b7a9ac6c7d0a tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.839s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:43:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:43:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:43:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:43:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:44:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:44:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:44:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:44:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:44:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG nova.objects.instance [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:44:22 user nova-compute[75453]: INFO nova.compute.manager [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attaching volume 02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 to /dev/vdb
Nov 28 14:44:22 user nova-compute[75453]: DEBUG os_brick.utils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5afd685-2ba0-42c0-b1ac-75838cb88ae7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2372a85e-348d-446a-a71e-bf9cf55594a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc9235a-1413-4e8b-bbd6-d5feea2a6f5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a263a-c23b-4d6e-ac89-4b86aa706504]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:44:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:23 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:44:23 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:44:23 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e5d8d8-b88e-42eb-bb32-a94e895a1fa0]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:44:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:44:23 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:44:23 user nova-compute[75453]: DEBUG os_brick.utils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:44:23 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating existing volume attachment record: 1018a2d2-5423-4e87-a793-f41c2c8f8b3c {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:44:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFChXoiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:44:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:44:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:44:29 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d00a25-2706-4811-96e4-501657860450]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:44:29 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0bf878-7176-42ae-9e71-b64719ef32b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08] added
Nov 28 14:44:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb187355-613d-4491-a4f0-7729d990b875]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[23017160-184e-47f0-b73b-f5bf062ca4a1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFChXoiQ {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFChXoiQ" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5570a5-31f2-41cd-8a09-69f7a9038bc9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFChXoiQ'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[74214aa4-6ddb-4bc4-93ea-a8fe9b6e6f3c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[081cadd9-3f38-47f1-8340-97b47ab63f25]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:44:29 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:44:29 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:44:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:44:29 user nova-compute[75453]: 
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6052050-1958-4c5a-8fbb-ca0b6cc9b628]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08, portal: 172.16.0.220,3260]
Nov 28 14:44:29 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08, portal: 172.16.0.220,3260] successful.
Nov 28 14:44:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4e2cf-72cc-47b4-9aa2-89d0fe9202c4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[877dddef-a398-4976-a35d-ebd4cbdf3f27]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 (non-flash)
Nov 28 14:44:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 (non-flash)
Nov 28 14:44:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b952d2-c714-40a2-9079-c9889193a048]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:44:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFChXoiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26136636538653535', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136636538653535', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG nova.objects.instance [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:44:30 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:44:30 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:44:30 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:44:30 user nova-compute[75453]:   <serial>02d43b32-f7b2-43a1-8c4b-c9800b8f0b08</serial>
Nov 28 14:44:30 user nova-compute[75453]: </disk>
Nov 28 14:44:30 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:44:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:44:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:44:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:44:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No VIF found with MAC fa:16:3e:7c:fa:10, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:44:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-9ca01dcb-052d-4e03-b24d-32a94c9d25e8 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.593s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:44:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:44:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:44:34 user nova-compute[75453]: INFO nova.compute.manager [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Detaching volume 02d43b32-f7b2-43a1-8c4b-c9800b8f0b08
Nov 28 14:44:34 user nova-compute[75453]: INFO nova.virt.block_device [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attempting to driver detach volume 02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 from mountpoint /dev/vdb
Nov 28 14:44:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Attempting to detach device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:44:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:44:34 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:44:34 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:44:34 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:44:34 user nova-compute[75453]:   <serial>02d43b32-f7b2-43a1-8c4b-c9800b8f0b08</serial>
Nov 28 14:44:34 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:44:34 user nova-compute[75453]: </disk>
Nov 28 14:44:34 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:44:34 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully detached device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the persistent domain config.
Nov 28 14:44:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da6e174b-68e8-413f-adc7-27c899ad004c from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:44:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:44:34 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:44:34 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:44:34 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:44:34 user nova-compute[75453]:   <serial>02d43b32-f7b2-43a1-8c4b-c9800b8f0b08</serial>
Nov 28 14:44:34 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:44:34 user nova-compute[75453]: </disk>
Nov 28 14:44:34 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:44:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:44:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:39 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:42 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:43 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:44:43 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:44:43 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=24.988224029541016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance da6e174b-68e8-413f-adc7-27c899ad004c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:44:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:44:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:44:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Updating instance_info_cache with network_info: [{"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:44:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:44:53 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:44:54 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da6e174b-68e8-413f-adc7-27c899ad004c is timed out.
Nov 28 14:44:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully detached device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the live domain config.
Nov 28 14:44:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFChXoiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:44:54 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6070c8-f4f3-4a79-af2f-52f425dfe74d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:44:54 user nova-compute[75453]: No targets found.
Nov 28 14:44:54 user nova-compute[75453]: iSNS:
Nov 28 14:44:54 user nova-compute[75453]: No targets found.
Nov 28 14:44:54 user nova-compute[75453]: STATIC:
Nov 28 14:44:54 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08
Nov 28 14:44:54 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:44:54 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:44:54 user nova-compute[75453]: FIRMWARE:
Nov 28 14:44:54 user nova-compute[75453]: No targets found.
Nov 28 14:44:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:44:54 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:44:54 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce32ffe-8d34-4350-a535-eea1e31f411f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7855ca8a-36af-41d1-9862-a95192ae1986]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 (non-flash)
Nov 28 14:44:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 (non-flash)
Nov 28 14:44:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0218713250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca7422c-f998-4426-896c-878f94d7e48b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a181bf-9438-44e7-9783-6d10ece57faa]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4608c8-fdd6-4153-b8f5-027a532db17c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae26dece-fdc1-448f-905b-16c65e3b4613]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2664b2-b16a-4441-b50a-3340b20edacf]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[169dc44d-bfc9-42ef-88a1-0a6c7fd7ab3c]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08, portal: 172.16.0.220,3260]
Nov 28 14:44:54 user nova-compute[75453]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08, portal: 172.16.0.220,3260] successful.
Nov 28 14:44:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02d43b32-f7b2-43a1-8c4b-c9800b8f0b08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bbc125-929e-40b5-bd67-08df23e240a4]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== disconnect_volume: return (308ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:44:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:44:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:44:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-de64028f-4494-4374-a7e7-a7e64bf16256 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.728s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:44:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:44:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:44:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:44:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:44:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:44:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:45:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received event network-changed-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:45:19 user nova-compute[75453]: DEBUG nova.compute.manager [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Refreshing instance network info cache due to event network-changed-4b6f3d19-5c51-46b3-9f2c-5171434afd99. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:45:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] Acquiring lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:45:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] Acquired lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:45:19 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Refreshing network info cache for port 4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:45:19 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Updated VIF entry in instance network info cache for port 4b6f3d19-5c51-46b3-9f2c-5171434afd99. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:45:19 user nova-compute[75453]: DEBUG nova.network.neutron [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Updating instance_info_cache with network_info: [{"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:45:19 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0d898fb8-1ec4-4a68-bd15-d41e47c36968 req-27bde3f3-8bdd-46d4-8fed-226ce11bf078 service nova] Releasing lock "refresh_cache-a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:45:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG nova.objects.instance [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lazy-loading 'flavor' on Instance uuid a9194d1d-5b78-47e2-9a7d-7c7adf178bbb {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:45:22 user nova-compute[75453]: INFO nova.compute.manager [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Attaching volume 195e340a-bb12-4ce5-8447-c0c620362f71 to /dev/vdb
Nov 28 14:45:22 user nova-compute[75453]: DEBUG os_brick.utils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c2acf0-e2ec-4ac4-a5c9-197864506a5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceb8a3c-2403-4212-abce-5d267412a5e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9b9e6b-046c-410e-9b35-1787956444d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacf4ae8-6e30-4b89-91cd-52f6f030d4d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:45:22 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:45:22 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc78cc-2c2b-4c32-971d-2e7ea1e5456b]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG os_brick.utils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:45:22 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Updating existing volume attachment record: 1c5708cd-3dac-445d-8e90-d9aa7ced5519 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:45:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG nova.objects.instance [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:45:27 user nova-compute[75453]: INFO nova.compute.manager [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attaching volume 7d6bee7a-e542-4719-b521-3fb34fa7179b to /dev/vdb
Nov 28 14:45:27 user nova-compute[75453]: DEBUG os_brick.utils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fc4e47-6a02-4e0d-bdbe-6d95cc54b861]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc3cf66-085a-4dcb-b70b-ff874c806a6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f9aa74-e54d-4046-8d6a-11acda31b6e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a69bc04-0ac4-4c81-96ef-a4006e82427f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:45:27 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:45:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9e3e6f-fb22-4b34-b45a-be719f7db996]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG os_brick.utils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:45:27 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating existing volume attachment record: ef6f3058-cc7e-4505-a05e-0ea4dbd575c1 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:45:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWItXind', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:45:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:45:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:45:29 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5da20be-6133-40ca-86cb-e3ce1b944665]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:45:29 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[757bcaf9-0937-4da8-a301-368aa66fed54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71] added
Nov 28 14:45:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5602aeb2-d6c0-41a8-a613-6c3bc9df1390]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d5b6a1-8e0d-4243-8773-83e476590856]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWItXind {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWItXind" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[591a4d75-8ecb-41d5-a4cd-4bb7ee458a71]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YWItXind'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee008256-27e3-4ffb-bebe-53d32ef0d5d0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fef3f16-edca-40fc-abdc-4a45f22cbe0e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:45:29 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:45:29 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:45:29 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:45:29 user nova-compute[75453]: 
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a1c0b2-ee91-4223-8a24-bdd35e6ccacf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71, portal: 172.16.0.220,3260]
Nov 28 14:45:29 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71, portal: 172.16.0.220,3260] successful.
Nov 28 14:45:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[10185bf2-426d-4240-8362-8024178f6001]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d356dfb-c129-45e6-bd81-746d2335f8b5]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)
Nov 28 14:45:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)
Nov 28 14:45:29 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4742a-066f-4deb-bd67-6d8227179942]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:29 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:45:30 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:45:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWItXind', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:45:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:45:30 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23663363033323661', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:45:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663363033323661', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:45:30 user nova-compute[75453]: DEBUG nova.objects.instance [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lazy-loading 'flavor' on Instance uuid a9194d1d-5b78-47e2-9a7d-7c7adf178bbb {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:45:30 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:45:30 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:45:30 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:45:30 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:45:30 user nova-compute[75453]:   <serial>195e340a-bb12-4ce5-8447-c0c620362f71</serial>
Nov 28 14:45:30 user nova-compute[75453]: </disk>
Nov 28 14:45:30 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:45:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:45:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:45:31 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] No VIF found with MAC fa:16:3e:7d:2c:50, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:45:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-aee626fe-33e2-4e99-b529-8cfca8fbef10 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.741s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:45:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:45:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:45:33 user nova-compute[75453]: INFO nova.compute.manager [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Detaching volume 195e340a-bb12-4ce5-8447-c0c620362f71
Nov 28 14:45:33 user nova-compute[75453]: INFO nova.virt.block_device [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Attempting to driver detach volume 195e340a-bb12-4ce5-8447-c0c620362f71 from mountpoint /dev/vdb
Nov 28 14:45:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Attempting to detach device vdb from instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:45:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:45:33 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:45:33 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:45:33 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:45:33 user nova-compute[75453]:   <serial>195e340a-bb12-4ce5-8447-c0c620362f71</serial>
Nov 28 14:45:33 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:45:33 user nova-compute[75453]: </disk>
Nov 28 14:45:33 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:45:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Successfully detached device vdb from instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb from the persistent domain config.
Nov 28 14:45:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:45:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:45:33 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:45:33 user nova-compute[75453]:   <source dev="/dev/sdb"/>
Nov 28 14:45:33 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:45:33 user nova-compute[75453]:   <serial>195e340a-bb12-4ce5-8447-c0c620362f71</serial>
Nov 28 14:45:33 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:45:33 user nova-compute[75453]: </disk>
Nov 28 14:45:33 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:45:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYWSsTHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:45:34 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:45:34 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:45:34 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d3fc8-2134-40be-91cc-2ecfdfe2be05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:45:34 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac650cea-9fab-4f88-aa18-7fb23d4a4b53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b] added
Nov 28 14:45:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde39bde-0abb-4e00-bf6a-ac6833353a0f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4426efcb-ccc9-4563-9d58-93f9244fc93f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYWSsTHG {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYWSsTHG" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc26c6a8-2532-4b4d-b8a7-4171498ea188]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yYWSsTHG'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4ad86-d6d5-4af9-aa50-5bb98128f64d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21536a8-7c66-4d1f-8b08-9593ab619278]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)
Nov 28 14:45:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)
Nov 28 14:45:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2431f91-893f-40e8-906d-c35543369af7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b, portal: 172.16.0.220,3260]
Nov 28 14:45:34 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b, portal: 172.16.0.220,3260] successful.
Nov 28 14:45:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f45a9-66a0-4862-8b2b-69a923566bb0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cffd2a1-16ae-419d-9c74-972906f2e736]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)
Nov 28 14:45:34 user nova-compute[75453]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b (non-flash)
Nov 28 14:45:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)
Nov 28 14:45:34 user nova-compute[75453]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b (non-flash)
Nov 28 14:45:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50180cd-d9fe-42fe-b8ed-d490ef7a98b9]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:45:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYWSsTHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23037393736353036', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037393736353036', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 14:45:35 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:45:35 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:45:35 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:45:35 user nova-compute[75453]:   <serial>7d6bee7a-e542-4719-b521-3fb34fa7179b</serial>
Nov 28 14:45:35 user nova-compute[75453]: </disk>
Nov 28 14:45:35 user nova-compute[75453]:  {{(pid=75453) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:45:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:45:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:45:36 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] No VIF found with MAC fa:16:3e:7c:fa:10, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:45:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-0c2ac51b-9f42-4c9a-b138-84ad592a2842 tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.117s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:45:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:45:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:45:38 user nova-compute[75453]: INFO nova.compute.manager [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Detaching volume 7d6bee7a-e542-4719-b521-3fb34fa7179b
Nov 28 14:45:38 user nova-compute[75453]: INFO nova.virt.block_device [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Attempting to driver detach volume 7d6bee7a-e542-4719-b521-3fb34fa7179b from mountpoint /dev/vdb
Nov 28 14:45:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Attempting to detach device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the persistent domain config. {{(pid=75453) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 14:45:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:45:38 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:45:38 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:45:38 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:45:38 user nova-compute[75453]:   <serial>7d6bee7a-e542-4719-b521-3fb34fa7179b</serial>
Nov 28 14:45:38 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:45:38 user nova-compute[75453]: </disk>
Nov 28 14:45:38 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:45:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully detached device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the persistent domain config.
Nov 28 14:45:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da6e174b-68e8-413f-adc7-27c899ad004c from the live domain config. {{(pid=75453) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 14:45:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.guest [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 14:45:38 user nova-compute[75453]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:45:38 user nova-compute[75453]:   <source dev="/dev/sdc"/>
Nov 28 14:45:38 user nova-compute[75453]:   <target dev="vdb" bus="virtio"/>
Nov 28 14:45:38 user nova-compute[75453]:   <serial>7d6bee7a-e542-4719-b521-3fb34fa7179b</serial>
Nov 28 14:45:38 user nova-compute[75453]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 14:45:38 user nova-compute[75453]: </disk>
Nov 28 14:45:38 user nova-compute[75453]:  {{(pid=75453) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 14:45:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 14:45:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:45:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:45:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:45 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:45:45 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:45:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=24.986682891845703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance da6e174b-68e8-413f-adc7-27c899ad004c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:45:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:45:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:45:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:45:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:45:49 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:45:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:45:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:45:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:45:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:45:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:45:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:45:50 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:45:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:51 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating instance_info_cache with network_info: [{"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:45:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-da6e174b-68e8-413f-adc7-27c899ad004c" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:45:51 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:45:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb is timed out.
Nov 28 14:45:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Successfully detached device vdb from instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb from the live domain config.
Nov 28 14:45:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWItXind', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:45:53 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[589df13d-7e9a-4e5c-b4e2-143ba4c38712]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:45:53 user nova-compute[75453]: No targets found.
Nov 28 14:45:53 user nova-compute[75453]: iSNS:
Nov 28 14:45:53 user nova-compute[75453]: No targets found.
Nov 28 14:45:53 user nova-compute[75453]: STATIC:
Nov 28 14:45:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71
Nov 28 14:45:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:45:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:45:53 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b
Nov 28 14:45:53 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:45:53 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:45:53 user nova-compute[75453]: FIRMWARE:
Nov 28 14:45:53 user nova-compute[75453]: No targets found.
Nov 28 14:45:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:45:53 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:45:53 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f83776f-2d28-4793-97e8-4ec02ac7d667]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aab15de-9d6c-4a46-97ea-718c5aa4f618]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)
Nov 28 14:45:53 user nova-compute[75453]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b (non-flash)
Nov 28 14:45:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 (non-flash)
Nov 28 14:45:53 user nova-compute[75453]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b (non-flash)
Nov 28 14:45:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02186ff1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[db97ced0-4690-40e9-9241-8ce84e2307b8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8125319-ecdd-4dcc-b063-ed3853856a57]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b448bd-0293-4d40-91d5-92ecc9fd494f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[54862c8e-ec9a-493f-9b92-edfc460b1f94]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76517cc-2f8e-495e-9901-de90a16ec90e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcb92e6-3c2c-4d56-9556-2d7deb3a9cb0]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71, portal: 172.16.0.220,3260]
Nov 28 14:45:53 user nova-compute[75453]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71, portal: 172.16.0.220,3260] successful.
Nov 28 14:45:53 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195e340a-bb12-4ce5-8447-c0c620362f71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee127c-a0f3-44f7-a9c1-2ed0db46460d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] <== disconnect_volume: return (330ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:45:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:45:54 user nova-compute[75453]: DEBUG nova.objects.instance [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lazy-loading 'flavor' on Instance uuid a9194d1d-5b78-47e2-9a7d-7c7adf178bbb {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:45:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-419d5a2a-5140-499d-bf05-5a7837ad1528 tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:45:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:45:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:45:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:45:59 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da6e174b-68e8-413f-adc7-27c899ad004c is timed out.
Nov 28 14:45:59 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully detached device vdb from instance da6e174b-68e8-413f-adc7-27c899ad004c from the live domain config.
Nov 28 14:45:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYWSsTHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:45:59 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae14601a-5579-4533-bffc-1bbdee1e8333]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:45:59 user nova-compute[75453]: No targets found.
Nov 28 14:45:59 user nova-compute[75453]: iSNS:
Nov 28 14:45:59 user nova-compute[75453]: No targets found.
Nov 28 14:45:59 user nova-compute[75453]: STATIC:
Nov 28 14:45:59 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b
Nov 28 14:45:59 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:45:59 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:45:59 user nova-compute[75453]: FIRMWARE:
Nov 28 14:45:59 user nova-compute[75453]: No targets found.
Nov 28 14:45:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:45:59 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:45:59 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a9912-fcb9-42e1-a485-dd0772e9cb63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9681f8-17e1-4465-8949-c2dc8d1eb48e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b (non-flash)
Nov 28 14:45:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b (non-flash)
Nov 28 14:45:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c611000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[675b4a8c-9654-46a9-a7f7-6413e6dffba0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e17c6b-7006-4903-8e6b-e4da9e73784c]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[796ce4b5-4c16-4268-adaf-5e8a62d952d6]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[739e948c-e63d-4408-8bac-b78963129f5a]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ec070a-d59c-49fd-a1e3-4aea61b13ac9]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5154b9c7-d746-4b5e-bf79-2e11953c8ce8]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b, portal: 172.16.0.220,3260]
Nov 28 14:45:59 user nova-compute[75453]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b, portal: 172.16.0.220,3260] successful.
Nov 28 14:45:59 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6bee7a-e542-4719-b521-3fb34fa7179b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[eade4048-5aa9-497b-a33e-6e7aea6eced0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] <== disconnect_volume: return (291ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:45:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:46:00 user nova-compute[75453]: DEBUG nova.objects.instance [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'flavor' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:46:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bc7edcb0-d20e-4780-86b7-8474a7b6bc0d tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.567s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:46:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:46:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:46:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:46:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:46:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:46:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:46:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:46:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:46:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:46:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:26 user nova-compute[75453]: INFO nova.compute.manager [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Terminating instance
Nov 28 14:46:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:46:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received event network-vif-unplugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] No waiting events found dispatching network-vif-unplugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG nova.compute.manager [req-3fb785be-b533-40f5-b654-c2fbac227288 req-f1dad732-2e1b-44ed-83d4-d032fdde7e9c service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received event network-vif-unplugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Instance destroyed successfully.
Nov 28 14:46:27 user nova-compute[75453]: DEBUG nova.objects.instance [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lazy-loading 'resources' on Instance uuid a9194d1d-5b78-47e2-9a7d-7c7adf178bbb {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826881',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1057826881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1057826',id=46,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHHW6xOOkXA6HO6AyAtKqVaWqyVEs+REq4AOqAeGr8O/kcUci05pEH4UptKQ7ADA4MvvQJQ9S1flPRz4ednzYhnCvycjaMwmgIoVO324NA/FvuJTcVVlJCZ83QkrfxBTA==',key_name='tempest-keypair-1925480414',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5869d755289842bf9d1e4006eed3ad7e',ramdisk_id='',reservation_id='r-wbh72s0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-172678324',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61811e8f2c74409c86b108ac9c7647e2',uuid=a9194d1d-5b78-47e2-9a7d-7c7adf178bbb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Converting VIF {"id": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "address": "fa:16:3e:7d:2c:50", "network": {"id": "f13184a0-39de-4810-a596-b27f7cd0bebd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1520289251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5869d755289842bf9d1e4006eed3ad7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6f3d19-5c", "ovs_interfaceid": "4b6f3d19-5c51-46b3-9f2c-5171434afd99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:2c:50,bridge_name='br-int',has_traffic_filtering=True,id=4b6f3d19-5c51-46b3-9f2c-5171434afd99,network=Network(f13184a0-39de-4810-a596-b27f7cd0bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6f3d19-5c') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG os_vif [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:2c:50,bridge_name='br-int',has_traffic_filtering=True,id=4b6f3d19-5c51-46b3-9f2c-5171434afd99,network=Network(f13184a0-39de-4810-a596-b27f7cd0bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6f3d19-5c') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b6f3d19-5c, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ba4a90e-7eb4-4375-a96b-ea4cd3791d42) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:27 user nova-compute[75453]: INFO os_vif [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:2c:50,bridge_name='br-int',has_traffic_filtering=True,id=4b6f3d19-5c51-46b3-9f2c-5171434afd99,network=Network(f13184a0-39de-4810-a596-b27f7cd0bebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6f3d19-5c')
Nov 28 14:46:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Deleting instance files /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb_del
Nov 28 14:46:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Deletion of /opt/stack/data/nova/instances/a9194d1d-5b78-47e2-9a7d-7c7adf178bbb_del complete
Nov 28 14:46:27 user nova-compute[75453]: INFO nova.compute.manager [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 14:46:27 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:46:27 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:46:28 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:46:28 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Took 0.78 seconds to deallocate network for instance.
Nov 28 14:46:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-212d2e36-9cd1-4dff-8d92-78d541338922 req-a0798ae3-8b08-4e7a-941f-2ca115336958 service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received event network-vif-deleted-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:46:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:28 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:46:28 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:46:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:28 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Deleted allocations for instance a9194d1d-5b78-47e2-9a7d-7c7adf178bbb
Nov 28 14:46:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-70825ec9-c1b3-47ec-9e7b-1859271a5d2d tempest-TestServerVolumeAttachScenarioOldVersion-172678324 tempest-TestServerVolumeAttachScenarioOldVersion-172678324-project-member] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.965s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received event network-vif-plugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:46:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] Acquiring lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] Lock "a9194d1d-5b78-47e2-9a7d-7c7adf178bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:29 user nova-compute[75453]: DEBUG nova.compute.manager [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] No waiting events found dispatching network-vif-plugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:46:29 user nova-compute[75453]: WARNING nova.compute.manager [req-2ebcb79e-eedc-487a-b838-60119677b1b0 req-d945edae-3c54-47bc-9222-9d2f27be150d service nova] [instance: a9194d1d-5b78-47e2-9a7d-7c7adf178bbb] Received unexpected event network-vif-plugged-4b6f3d19-5c51-46b3-9f2c-5171434afd99 for instance with vm_state deleted and task_state None.
Nov 28 14:46:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:41 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:44 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:46:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:46:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:46:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:46:44 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:46:45 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:46:45 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.013484954833984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance da6e174b-68e8-413f-adc7-27c899ad004c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:46:45 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:46:46 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:46:46 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:46:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:47 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:47 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:46:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:46:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:46:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:52 user nova-compute[75453]: INFO nova.compute.manager [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Terminating instance
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received event network-vif-unplugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] No waiting events found dispatching network-vif-unplugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-a5e1eb35-d439-43f8-854c-6dcecb7cd789 req-1178fe85-3fda-478e-8ff9-25dd1da6d155 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received event network-vif-unplugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Instance destroyed successfully.
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.objects.instance [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lazy-loading 'resources' on Instance uuid da6e174b-68e8-413f-adc7-27c899ad004c {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-970246909',display_name='tempest-SnapshotDataIntegrityTests-server-970246909',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-970246909',id=45,image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBaKb7rg6g18x4j0eX1QsE3yUrnfWe74mIrqrgLURwj6/hcCtSxFbZTDVQGURU3/kHArSgm8BsUBT8Ti0m+d6rAKAIHzukl416ZdeeOkKnesdNlp7zR6Oa/aR2XNNr1/w==',key_name='tempest-keypair-1040277365',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1e256bfa6e74f7bbd126a9fd943644d',ramdisk_id='',reservation_id='r-delz6xqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0d03e2fc-4d16-4fd7-9616-933da07dcf7b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1639319271',owner_user_name='tempest-SnapshotDataIntegrityTests-1639319271-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4c1c7c913b841ab85f8615bc9f8fc04',uuid=da6e174b-68e8-413f-adc7-27c899ad004c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Converting VIF {"id": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "address": "fa:16:3e:7c:fa:10", "network": {"id": "c4f5d8c6-5294-4666-a5ad-5359bd17d219", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-427382401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e256bfa6e74f7bbd126a9fd943644d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9659cf88-5a", "ovs_interfaceid": "9659cf88-5aba-4655-ab65-0dbc2163dc2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:fa:10,bridge_name='br-int',has_traffic_filtering=True,id=9659cf88-5aba-4655-ab65-0dbc2163dc2a,network=Network(c4f5d8c6-5294-4666-a5ad-5359bd17d219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9659cf88-5a') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG os_vif [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:fa:10,bridge_name='br-int',has_traffic_filtering=True,id=9659cf88-5aba-4655-ab65-0dbc2163dc2a,network=Network(c4f5d8c6-5294-4666-a5ad-5359bd17d219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9659cf88-5a') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9659cf88-5a, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e89ad77-92be-4c81-a406-c72ed3f0d684) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:46:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:46:52 user nova-compute[75453]: INFO os_vif [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:fa:10,bridge_name='br-int',has_traffic_filtering=True,id=9659cf88-5aba-4655-ab65-0dbc2163dc2a,network=Network(c4f5d8c6-5294-4666-a5ad-5359bd17d219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9659cf88-5a')
Nov 28 14:46:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Deleting instance files /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c_del
Nov 28 14:46:52 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Deletion of /opt/stack/data/nova/instances/da6e174b-68e8-413f-adc7-27c899ad004c_del complete
Nov 28 14:46:53 user nova-compute[75453]: INFO nova.compute.manager [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 14:46:53 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:46:53 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:46:53 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:46:53 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:46:53 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Took 0.68 seconds to deallocate network for instance.
Nov 28 14:46:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received event network-vif-deleted-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:46:53 user nova-compute[75453]: INFO nova.compute.manager [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Neutron deleted interface 9659cf88-5aba-4655-ab65-0dbc2163dc2a; detaching it from the instance and deleting it from the info cache
Nov 28 14:46:53 user nova-compute[75453]: DEBUG nova.network.neutron [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:46:53 user nova-compute[75453]: DEBUG nova.compute.manager [req-1811804b-db7b-4ac9-ad60-2ed641aa89ea req-b04d19c2-6be1-42e4-a116-3456b97bea56 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Detach interface failed, port_id=9659cf88-5aba-4655-ab65-0dbc2163dc2a, reason: Instance da6e174b-68e8-413f-adc7-27c899ad004c could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 14:46:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:53 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:46:53 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:46:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:54 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Deleted allocations for instance da6e174b-68e8-413f-adc7-27c899ad004c
Nov 28 14:46:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-96a11650-f221-444f-8b25-e85673ac57fa tempest-SnapshotDataIntegrityTests-1639319271 tempest-SnapshotDataIntegrityTests-1639319271-project-member] Lock "da6e174b-68e8-413f-adc7-27c899ad004c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received event network-vif-plugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:46:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] Acquiring lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:46:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:46:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] Lock "da6e174b-68e8-413f-adc7-27c899ad004c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:46:54 user nova-compute[75453]: DEBUG nova.compute.manager [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] No waiting events found dispatching network-vif-plugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:46:54 user nova-compute[75453]: WARNING nova.compute.manager [req-3fe8908b-4583-4e05-8660-92e74360ea9f req-d0cfd32a-396b-483e-b779-4c323306ded1 service nova] [instance: da6e174b-68e8-413f-adc7-27c899ad004c] Received unexpected event network-vif-plugged-9659cf88-5aba-4655-ab65-0dbc2163dc2a for instance with vm_state deleted and task_state None.
Nov 28 14:46:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:46:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:47:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:47:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:47:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:47:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:47:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:47:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:47:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:47:46 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:47:46 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:47:47 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:47:47 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9101MB free_disk=25.031021118164062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "a9fccc41-f928-4fea-a8aa-669cc1889847" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:47:47 user nova-compute[75453]: INFO nova.compute.claims [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Claim successful on node user
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:47:47 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:47:47 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:47:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:48 user nova-compute[75453]: INFO nova.virt.block_device [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Booting with volume snapshot 1840543d-d85e-403b-a614-e9974126a065 at /dev/vda
Nov 28 14:47:48 user nova-compute[75453]: DEBUG nova.policy [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:47:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:49 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Successfully created port: 61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:47:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Successfully updated port: 61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "refresh_cache-a9fccc41-f928-4fea-a8aa-669cc1889847" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquired lock "refresh_cache-a9fccc41-f928-4fea-a8aa-669cc1889847" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received event network-changed-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG nova.compute.manager [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Refreshing instance network info cache due to event network-changed-61141649-30cf-459d-9ddc-261b3c0b0280. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] Acquiring lock "refresh_cache-a9fccc41-f928-4fea-a8aa-669cc1889847" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG nova.network.neutron [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Updating instance_info_cache with network_info: [{"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Releasing lock "refresh_cache-a9fccc41-f928-4fea-a8aa-669cc1889847" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Instance network_info: |[{"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] Acquired lock "refresh_cache-a9fccc41-f928-4fea-a8aa-669cc1889847" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:47:50 user nova-compute[75453]: DEBUG nova.network.neutron [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Refreshing network info cache for port 61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:47:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Updated VIF entry in instance network info cache for port 61141649-30cf-459d-9ddc-261b3c0b0280. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:47:51 user nova-compute[75453]: DEBUG nova.network.neutron [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Updating instance_info_cache with network_info: [{"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:47:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1f9e4ea8-d4cf-4dd6-800a-883bb9cecdc5 req-51a52c61-4b9d-447b-9cbe-6c6b35e493cd service nova] Releasing lock "refresh_cache-a9fccc41-f928-4fea-a8aa-669cc1889847" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG os_brick.utils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c41cb-f2b7-4837-bb69-a7e18a463405]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[df00e7f1-9ee8-49a3-aeaf-aa2ac37c8ac9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8923ac9a-cdc0-4d42-9857-8ed8ecac8833]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe51118-df10-4f89-80bf-11dc036c604a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:47:53 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:47:53 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a1d0eb-4e9a-4458-8ef0-58262ded1029]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG os_brick.utils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:47:53 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Updating existing volume attachment record: c345dc03-fac3-4c1d-8d6d-1ff2987aeb83 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:47:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:47:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:47:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Skipping network cache update for instance because it is Building. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 14:47:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:47:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:47:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:48:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Creating image(s)
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Ensure instance console log exists: /opt/stack/data/nova/instances/a9fccc41-f928-4fea-a8aa-669cc1889847/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Start _get_guest_xml network_info=[{"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c345dc03-fac3-4c1d-8d6d-1ff2987aeb83', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGZKqFbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9fccc41-f928-4fea-a8aa-669cc1889847', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb5af133-14c7-4a48-b7a4-5bfbf544de6a', 'serial': 'bb5af133-14c7-4a48-b7a4-5bfbf544de6a'}, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:48:00 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:48:00 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGZKqFbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:48:00 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:48:00 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:48:00 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebac90eb-c2e0-4e82-9b98-ad61bc7c31cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:48:00 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6590e5f3-6387-4e57-acbd-818650b83d63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a] added
Nov 28 14:48:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26622f6-1163-4129-a409-79512fdbb8e1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da221d6-ace1-498c-a58b-9cd2f84a991c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGZKqFbx {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGZKqFbx" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e322353b-d66b-4572-9192-9ff2873dec32]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rGZKqFbx'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0cffc2-d8d3-4f7a-b39f-a69c0bc80f6d]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac96d2d-7079-4e3a-931f-6b4385fc15b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:48:00 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:48:00 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:48:00 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:48:00 user nova-compute[75453]: 
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdd3329-00a2-4167-a420-9172c941998d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a, portal: 172.16.0.220,3260]
Nov 28 14:48:00 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a, portal: 172.16.0.220,3260] successful.
Nov 28 14:48:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6c41b0-8b53-4942-a9a1-06467d761074]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6162067-326c-4928-abf3-e72e14ad8c57]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a (non-flash)
Nov 28 14:48:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a (non-flash)
Nov 28 14:48:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8116e595-f043-4b91-b465-b56a94ae9a30]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:48:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGZKqFbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26266666164323563', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266666164323563', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1541938524',display_name='tempest-TestVolumeBootPattern-server-1541938524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1541938524',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-ugeyk4b6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:47:48Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=a9fccc41-f928-4fea-a8aa-669cc1889847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=61141649-30cf-459d-9ddc-261b3c0b0280,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61141649-30') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.objects.instance [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'pci_devices' on Instance uuid a9fccc41-f928-4fea-a8aa-669cc1889847 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:48:01 user nova-compute[75453]:   <uuid>a9fccc41-f928-4fea-a8aa-669cc1889847</uuid>
Nov 28 14:48:01 user nova-compute[75453]:   <name>instance-0000002f</name>
Nov 28 14:48:01 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:48:01 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:48:01 user nova-compute[75453]:   <metadata>
Nov 28 14:48:01 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:48:01 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:48:01 user nova-compute[75453]:       <nova:name>tempest-TestVolumeBootPattern-server-1541938524</nova:name>
Nov 28 14:48:01 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:48:00</nova:creationTime>
Nov 28 14:48:01 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:48:01 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:48:01 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:48:01 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:48:01 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:48:01 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:48:01 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:48:01 user nova-compute[75453]:       <nova:owner>
Nov 28 14:48:01 user nova-compute[75453]:         <nova:user uuid="ff4761ea9f664afd889cdcbda34787ad">tempest-TestVolumeBootPattern-930393037-project-member</nova:user>
Nov 28 14:48:01 user nova-compute[75453]:         <nova:project uuid="193290c25f24467eac18c8a58e647834">tempest-TestVolumeBootPattern-930393037</nova:project>
Nov 28 14:48:01 user nova-compute[75453]:       </nova:owner>
Nov 28 14:48:01 user nova-compute[75453]:       <nova:ports>
Nov 28 14:48:01 user nova-compute[75453]:         <nova:port uuid="61141649-30cf-459d-9ddc-261b3c0b0280">
Nov 28 14:48:01 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 14:48:01 user nova-compute[75453]:         </nova:port>
Nov 28 14:48:01 user nova-compute[75453]:       </nova:ports>
Nov 28 14:48:01 user nova-compute[75453]:     </nova:instance>
Nov 28 14:48:01 user nova-compute[75453]:   </metadata>
Nov 28 14:48:01 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:48:01 user nova-compute[75453]:     <system>
Nov 28 14:48:01 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:48:01 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:48:01 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:48:01 user nova-compute[75453]:       <entry name="serial">a9fccc41-f928-4fea-a8aa-669cc1889847</entry>
Nov 28 14:48:01 user nova-compute[75453]:       <entry name="uuid">a9fccc41-f928-4fea-a8aa-669cc1889847</entry>
Nov 28 14:48:01 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:48:01 user nova-compute[75453]:     </system>
Nov 28 14:48:01 user nova-compute[75453]:   </sysinfo>
Nov 28 14:48:01 user nova-compute[75453]:   <os>
Nov 28 14:48:01 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:48:01 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:48:01 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:48:01 user nova-compute[75453]:   </os>
Nov 28 14:48:01 user nova-compute[75453]:   <features>
Nov 28 14:48:01 user nova-compute[75453]:     <acpi/>
Nov 28 14:48:01 user nova-compute[75453]:     <apic/>
Nov 28 14:48:01 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:48:01 user nova-compute[75453]:   </features>
Nov 28 14:48:01 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:48:01 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:48:01 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:48:01 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:48:01 user nova-compute[75453]:   </clock>
Nov 28 14:48:01 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:48:01 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:48:01 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:48:01 user nova-compute[75453]:   </cpu>
Nov 28 14:48:01 user nova-compute[75453]:   <devices>
Nov 28 14:48:01 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:48:01 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:48:01 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:48:01 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:48:01 user nova-compute[75453]:       <serial>bb5af133-14c7-4a48-b7a4-5bfbf544de6a</serial>
Nov 28 14:48:01 user nova-compute[75453]:     </disk>
Nov 28 14:48:01 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:48:01 user nova-compute[75453]:       <mac address="fa:16:3e:e7:39:d9"/>
Nov 28 14:48:01 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:48:01 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:48:01 user nova-compute[75453]:       <target dev="tap61141649-30"/>
Nov 28 14:48:01 user nova-compute[75453]:     </interface>
Nov 28 14:48:01 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:48:01 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/a9fccc41-f928-4fea-a8aa-669cc1889847/console.log" append="off"/>
Nov 28 14:48:01 user nova-compute[75453]:     </serial>
Nov 28 14:48:01 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:48:01 user nova-compute[75453]:     <video>
Nov 28 14:48:01 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:48:01 user nova-compute[75453]:     </video>
Nov 28 14:48:01 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:48:01 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:48:01 user nova-compute[75453]:     </rng>
Nov 28 14:48:01 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:48:01 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:48:01 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:48:01 user nova-compute[75453]:     </memballoon>
Nov 28 14:48:01 user nova-compute[75453]:   </devices>
Nov 28 14:48:01 user nova-compute[75453]: </domain>
Nov 28 14:48:01 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1541938524',display_name='tempest-TestVolumeBootPattern-server-1541938524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1541938524',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-ugeyk4b6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:47:48Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=a9fccc41-f928-4fea-a8aa-669cc1889847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=61141649-30cf-459d-9ddc-261b3c0b0280,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61141649-30') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG os_vif [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=61141649-30cf-459d-9ddc-261b3c0b0280,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61141649-30') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9a74842-9280-5fed-b60c-6f84780dd55d', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61141649-30, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61141649-30, col_values=(('qos', UUID('7ba9522c-72c1-449d-888d-c14be2a6e33a')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61141649-30, col_values=(('external_ids', {'iface-id': '61141649-30cf-459d-9ddc-261b3c0b0280', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:39:d9', 'vm-uuid': 'a9fccc41-f928-4fea-a8aa-669cc1889847'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:01 user nova-compute[75453]: INFO os_vif [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=61141649-30cf-459d-9ddc-261b3c0b0280,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61141649-30')
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:48:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No VIF found with MAC fa:16:3e:e7:39:d9, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received event network-vif-plugged-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] Acquiring lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] No waiting events found dispatching network-vif-plugged-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:48:03 user nova-compute[75453]: WARNING nova.compute.manager [req-aa7bf437-3362-4d85-9cc1-0ffc75462274 req-f3c4628e-0f0b-4381-80a4-ca73c8634cc8 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received unexpected event network-vif-plugged-61141649-30cf-459d-9ddc-261b3c0b0280 for instance with vm_state building and task_state spawning.
Nov 28 14:48:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:48:05 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Instance spawned successfully.
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:48:05 user nova-compute[75453]: INFO nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received event network-vif-plugged-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] Acquiring lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:48:05 user nova-compute[75453]: DEBUG nova.compute.manager [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] No waiting events found dispatching network-vif-plugged-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:48:05 user nova-compute[75453]: WARNING nova.compute.manager [req-ca3362d5-92f6-46c1-a693-ce7dae4f20e4 req-54a6fe0f-1fdd-4566-9bd6-69123cf22b90 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received unexpected event network-vif-plugged-61141649-30cf-459d-9ddc-261b3c0b0280 for instance with vm_state building and task_state spawning.
Nov 28 14:48:05 user nova-compute[75453]: INFO nova.compute.manager [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Took 17.83 seconds to build instance.
Nov 28 14:48:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-d08b8bf0-abb5-4c39-ba70-c9d9f96fcab3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.928s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:48:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:20 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:48:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:48:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:48:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:48:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:48:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:48:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:48:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:48:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:48:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:48:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:48:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:48:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:48:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:48:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:48:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:48:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:48:48 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:48:48 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:48:48 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:48:48 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:48:48 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.029041290283203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:48:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:48:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:48:49 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance a9fccc41-f928-4fea-a8aa-669cc1889847 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:48:49 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:48:49 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:48:49 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:48:49 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:48:49 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:48:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:48:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:48:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:48:52 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:48:52 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:48:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:48:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:48:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:48:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:48:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-a9fccc41-f928-4fea-a8aa-669cc1889847" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:48:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-a9fccc41-f928-4fea-a8aa-669cc1889847" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:48:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:48:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid a9fccc41-f928-4fea-a8aa-669cc1889847 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:48:55 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Updating instance_info_cache with network_info: [{"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:48:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-a9fccc41-f928-4fea-a8aa-669cc1889847" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:48:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:48:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:48:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:48:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:48:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:48:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:48:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:48:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:48:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:49:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:49:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:49:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:49:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:49:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:49:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:49:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:49:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:49:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:49:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:49:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:49:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:49:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:49:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "a9fccc41-f928-4fea-a8aa-669cc1889847" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:49:38 user nova-compute[75453]: INFO nova.compute.manager [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Terminating instance
Nov 28 14:49:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received event network-vif-unplugged-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] Acquiring lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] No waiting events found dispatching network-vif-unplugged-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-1a6acd59-4fe6-4c55-911b-f6d290a793a6 req-4e3bacf6-8ab3-4b36-a1dc-8aba9135b0b4 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received event network-vif-unplugged-61141649-30cf-459d-9ddc-261b3c0b0280 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:49:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:39 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Instance destroyed successfully.
Nov 28 14:49:39 user nova-compute[75453]: DEBUG nova.objects.instance [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'resources' on Instance uuid a9fccc41-f928-4fea-a8aa-669cc1889847 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1541938524',display_name='tempest-TestVolumeBootPattern-server-1541938524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1541938524',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:48:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-ugeyk4b6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:48:05Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=a9fccc41-f928-4fea-a8aa-669cc1889847,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "61141649-30cf-459d-9ddc-261b3c0b0280", "address": "fa:16:3e:e7:39:d9", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61141649-30", "ovs_interfaceid": "61141649-30cf-459d-9ddc-261b3c0b0280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=61141649-30cf-459d-9ddc-261b3c0b0280,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61141649-30') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_vif [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=61141649-30cf-459d-9ddc-261b3c0b0280,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61141649-30') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61141649-30, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ba9522c-72c1-449d-888d-c14be2a6e33a) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:39 user nova-compute[75453]: INFO os_vif [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:39:d9,bridge_name='br-int',has_traffic_filtering=True,id=61141649-30cf-459d-9ddc-261b3c0b0280,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61141649-30')
Nov 28 14:49:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGZKqFbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:49:39 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[428bb84a-9cb2-49b2-9c54-66af426476c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:49:39 user nova-compute[75453]: No targets found.
Nov 28 14:49:39 user nova-compute[75453]: iSNS:
Nov 28 14:49:39 user nova-compute[75453]: No targets found.
Nov 28 14:49:39 user nova-compute[75453]: STATIC:
Nov 28 14:49:39 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a
Nov 28 14:49:39 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:49:39 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:49:39 user nova-compute[75453]: FIRMWARE:
Nov 28 14:49:39 user nova-compute[75453]: No targets found.
Nov 28 14:49:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:49:39 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:49:39 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8da672-ffce-4ebc-929f-b488011e2acd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a240080-5e3f-4f95-9e55-736b79695675]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a (non-flash)
Nov 28 14:49:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a (non-flash)
Nov 28 14:49:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0218776710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a90cce-409d-4923-a9fe-70e92280a715]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c2b6b-66d7-47b8-9ce0-c79614230c86]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[493725be-6fd3-42d1-8bfc-fafd4b55715f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e961c7e-a1d7-4dff-bf0f-3d04516781bb]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOefeb973e-bffad25cacc26169', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_efeb973e', '/dev/disk/by-id/scsi-26266666164323563') {{(pid=86546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce8f72-b8d8-4020-8161-c34350c84e6f]: (4, None) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d6ac14-7330-459e-b95d-10dc26808788]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dda3de-bee0-491c-b43d-0dfe3339e34e]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a, portal: 172.16.0.220,3260]
Nov 28 14:49:39 user nova-compute[75453]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a, portal: 172.16.0.220,3260] successful.
Nov 28 14:49:39 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb5af133-14c7-4a48-b7a4-5bfbf544de6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0476737-39cc-4fac-a53b-9598f72b3f4c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== disconnect_volume: return (272ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:49:39 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Deleting instance files /opt/stack/data/nova/instances/a9fccc41-f928-4fea-a8aa-669cc1889847_del
Nov 28 14:49:39 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Deletion of /opt/stack/data/nova/instances/a9fccc41-f928-4fea-a8aa-669cc1889847_del complete
Nov 28 14:49:39 user nova-compute[75453]: INFO nova.compute.manager [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 28 14:49:39 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:49:39 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:49:39 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Took 0.40 seconds to deallocate network for instance.
Nov 28 14:49:40 user nova-compute[75453]: DEBUG nova.compute.manager [req-9ec23a2a-c9eb-42bb-8483-6c9ea2080d6c req-b11fc5a8-64de-44bf-b886-f6e7a6797670 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received event network-vif-deleted-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:49:40 user nova-compute[75453]: DEBUG nova.compute.manager [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received event network-vif-plugged-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:49:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] Acquiring lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:49:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:49:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:49:40 user nova-compute[75453]: DEBUG nova.compute.manager [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] No waiting events found dispatching network-vif-plugged-61141649-30cf-459d-9ddc-261b3c0b0280 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:49:40 user nova-compute[75453]: WARNING nova.compute.manager [req-b89f8300-cb22-429e-a831-585230940556 req-b9f3845e-ac45-41e7-ae31-1c65778ce642 service nova] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Received unexpected event network-vif-plugged-61141649-30cf-459d-9ddc-261b3c0b0280 for instance with vm_state active and task_state deleting.
Nov 28 14:49:40 user nova-compute[75453]: INFO nova.compute.manager [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Took 0.93 seconds to detach 1 volumes for instance.
Nov 28 14:49:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: a9fccc41-f928-4fea-a8aa-669cc1889847] Deleting volume: bb5af133-14c7-4a48-b7a4-5bfbf544de6a {{(pid=75453) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 14:49:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:49:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:49:41 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:49:41 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:49:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:49:41 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Deleted allocations for instance a9fccc41-f928-4fea-a8aa-669cc1889847
Nov 28 14:49:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-e5d4e934-936c-4ace-9d29-904fd1eae3dc tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "a9fccc41-f928-4fea-a8aa-669cc1889847" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.975s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:49:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:49:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:49:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:49:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:49:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:49:49 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:49:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:49:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:49:50 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:49:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:49:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:49:50 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9149MB free_disk=25.02819061279297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:49:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:49:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:49:50 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:49:50 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:49:51 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:49:51 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:49:51 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:49:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:49:53 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:53 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:49:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:49:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:49:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:49:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:49:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:49:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:50:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:50:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:50:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:50:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:50:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:50:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:50:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:50:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:50:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:50:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:50:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:50:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "97bf844f-f4bd-4a41-b734-9a294b506b02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:50:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:50:42 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:50:43 user nova-compute[75453]: INFO nova.compute.claims [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Claim successful on node user
Nov 28 14:50:43 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:50:43 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:50:43 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG nova.policy [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:50:43 user nova-compute[75453]: INFO nova.virt.block_device [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Booting with volume fa43a66e-7d14-41b9-8486-7a6102750171 at /dev/vda
Nov 28 14:50:43 user nova-compute[75453]: DEBUG os_brick.utils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[290ef075-bd82-4d8f-b6bd-72037a1ccb36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4c37a0-47a7-4501-90d5-4b20e2dc9f83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da0f5a6-26d8-47f1-893b-2bff6183eefe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e0f4f7-e3e5-4cc3-a999-878f207f574d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:50:43 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:50:43 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee31da5-fc13-44a9-be74-51b455906c97]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG os_brick.utils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:50:43 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updating existing volume attachment record: c77c47f9-bd99-4c89-b36e-9e501611f976 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Successfully created port: c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Successfully updated port: c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquired lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received event network-changed-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG nova.compute.manager [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Refreshing instance network info cache due to event network-changed-c07fafbf-3e88-4dfa-9c41-ad99ee82416e. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] Acquiring lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:50:44 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:50:45 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updating instance_info_cache with network_info: [{"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:50:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Releasing lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:50:45 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Instance network_info: |[{"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:50:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] Acquired lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:50:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Refreshing network info cache for port c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:50:45 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updated VIF entry in instance network info cache for port c07fafbf-3e88-4dfa-9c41-ad99ee82416e. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:50:45 user nova-compute[75453]: DEBUG nova.network.neutron [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updating instance_info_cache with network_info: [{"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:50:45 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f15275a9-fc4c-4140-ad9a-fa47fbeb2428 req-b76469f3-b74e-476d-8986-6fe64061c9c8 service nova] Releasing lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:50:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:50:50 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Creating image(s)
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Ensure instance console log exists: /opt/stack/data/nova/instances/97bf844f-f4bd-4a41-b734-9a294b506b02/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Start _get_guest_xml network_info=[{"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c77c47f9-bd99-4c89-b36e-9e501611f976', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knwTobSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97bf844f-f4bd-4a41-b734-9a294b506b02', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa43a66e-7d14-41b9-8486-7a6102750171', 'serial': 'fa43a66e-7d14-41b9-8486-7a6102750171'}, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:50:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:50:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knwTobSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:50:50 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:50:50 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:50:50 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a7bbc3-a9b8-4813-8750-16d7defb1cd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:50:50 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae803f91-b316-4fad-9421-2d981a18c76a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171] added
Nov 28 14:50:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09818de-d6f6-461b-9981-d3aab40cf924]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2c0aab-d7d7-44aa-81e2-98eb7fcc191e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knwTobSh {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knwTobSh" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d803a-d690-4c61-b239-061813ac7bff]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knwTobSh'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a74458c-650a-4d73-b681-24397afa9149]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a0f834-10ab-4bdf-8650-4dcae5f1ec2d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:50:50 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:50:50 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:50:50 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:50:50 user nova-compute[75453]: 
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0a5d5-c3ac-4778-872a-f53ee2d3d084]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171, portal: 172.16.0.220,3260]
Nov 28 14:50:50 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171, portal: 172.16.0.220,3260] successful.
Nov 28 14:50:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c9db27-5864-453a-b3d3-200b6e2b1e8f]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b262bc-191e-4db5-8009-f4b9797607c0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:50:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:50:50 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d79a88-96a3-4992-9574-19ab7ddcf3cb]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knwTobSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:50:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:50:50 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9147MB free_disk=25.026840209960938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:50:50 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23663653631393832', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663653631393832', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-358520062',display_name='tempest-TestVolumeBootPattern-volume-backed-server-358520062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-358520062',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhB2kJ20aciKhL9XO+yEcWexH9qTAOKavq0XBDXr6Xy+MdWT0FlTwKQDfAIRX1gg9yUaIqUoa/biZ3jVEhPDOL+0zGdQle1eLvjoUiGakKYViDdIuRtzlPgHCGb5H2PGA==',key_name='tempest-keypair-859234956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-0dqxat0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=97bf844f-f4bd-4a41-b734-9a294b506b02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:8f:42,bridge_name='br-int',has_traffic_filtering=True,id=c07fafbf-3e88-4dfa-9c41-ad99ee82416e,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc07fafbf-3e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'pci_devices' on Instance uuid 97bf844f-f4bd-4a41-b734-9a294b506b02 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:50:51 user nova-compute[75453]:   <uuid>97bf844f-f4bd-4a41-b734-9a294b506b02</uuid>
Nov 28 14:50:51 user nova-compute[75453]:   <name>instance-00000030</name>
Nov 28 14:50:51 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:50:51 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:50:51 user nova-compute[75453]:   <metadata>
Nov 28 14:50:51 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:50:51 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:50:51 user nova-compute[75453]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-358520062</nova:name>
Nov 28 14:50:51 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:50:50</nova:creationTime>
Nov 28 14:50:51 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:50:51 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:50:51 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:50:51 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:50:51 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:50:51 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:50:51 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:50:51 user nova-compute[75453]:       <nova:owner>
Nov 28 14:50:51 user nova-compute[75453]:         <nova:user uuid="ff4761ea9f664afd889cdcbda34787ad">tempest-TestVolumeBootPattern-930393037-project-member</nova:user>
Nov 28 14:50:51 user nova-compute[75453]:         <nova:project uuid="193290c25f24467eac18c8a58e647834">tempest-TestVolumeBootPattern-930393037</nova:project>
Nov 28 14:50:51 user nova-compute[75453]:       </nova:owner>
Nov 28 14:50:51 user nova-compute[75453]:       <nova:ports>
Nov 28 14:50:51 user nova-compute[75453]:         <nova:port uuid="c07fafbf-3e88-4dfa-9c41-ad99ee82416e">
Nov 28 14:50:51 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 14:50:51 user nova-compute[75453]:         </nova:port>
Nov 28 14:50:51 user nova-compute[75453]:       </nova:ports>
Nov 28 14:50:51 user nova-compute[75453]:     </nova:instance>
Nov 28 14:50:51 user nova-compute[75453]:   </metadata>
Nov 28 14:50:51 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:50:51 user nova-compute[75453]:     <system>
Nov 28 14:50:51 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:50:51 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:50:51 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:50:51 user nova-compute[75453]:       <entry name="serial">97bf844f-f4bd-4a41-b734-9a294b506b02</entry>
Nov 28 14:50:51 user nova-compute[75453]:       <entry name="uuid">97bf844f-f4bd-4a41-b734-9a294b506b02</entry>
Nov 28 14:50:51 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:50:51 user nova-compute[75453]:     </system>
Nov 28 14:50:51 user nova-compute[75453]:   </sysinfo>
Nov 28 14:50:51 user nova-compute[75453]:   <os>
Nov 28 14:50:51 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:50:51 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:50:51 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:50:51 user nova-compute[75453]:   </os>
Nov 28 14:50:51 user nova-compute[75453]:   <features>
Nov 28 14:50:51 user nova-compute[75453]:     <acpi/>
Nov 28 14:50:51 user nova-compute[75453]:     <apic/>
Nov 28 14:50:51 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:50:51 user nova-compute[75453]:   </features>
Nov 28 14:50:51 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:50:51 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:50:51 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:50:51 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:50:51 user nova-compute[75453]:   </clock>
Nov 28 14:50:51 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:50:51 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:50:51 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:50:51 user nova-compute[75453]:   </cpu>
Nov 28 14:50:51 user nova-compute[75453]:   <devices>
Nov 28 14:50:51 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:50:51 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:50:51 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:50:51 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:50:51 user nova-compute[75453]:       <serial>fa43a66e-7d14-41b9-8486-7a6102750171</serial>
Nov 28 14:50:51 user nova-compute[75453]:     </disk>
Nov 28 14:50:51 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:50:51 user nova-compute[75453]:       <mac address="fa:16:3e:87:8f:42"/>
Nov 28 14:50:51 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:50:51 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:50:51 user nova-compute[75453]:       <target dev="tapc07fafbf-3e"/>
Nov 28 14:50:51 user nova-compute[75453]:     </interface>
Nov 28 14:50:51 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:50:51 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/97bf844f-f4bd-4a41-b734-9a294b506b02/console.log" append="off"/>
Nov 28 14:50:51 user nova-compute[75453]:     </serial>
Nov 28 14:50:51 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:50:51 user nova-compute[75453]:     <video>
Nov 28 14:50:51 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:50:51 user nova-compute[75453]:     </video>
Nov 28 14:50:51 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:50:51 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:50:51 user nova-compute[75453]:     </rng>
Nov 28 14:50:51 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:50:51 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:50:51 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:50:51 user nova-compute[75453]:     </memballoon>
Nov 28 14:50:51 user nova-compute[75453]:   </devices>
Nov 28 14:50:51 user nova-compute[75453]: </domain>
Nov 28 14:50:51 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-358520062',display_name='tempest-TestVolumeBootPattern-volume-backed-server-358520062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-358520062',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhB2kJ20aciKhL9XO+yEcWexH9qTAOKavq0XBDXr6Xy+MdWT0FlTwKQDfAIRX1gg9yUaIqUoa/biZ3jVEhPDOL+0zGdQle1eLvjoUiGakKYViDdIuRtzlPgHCGb5H2PGA==',key_name='tempest-keypair-859234956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-0dqxat0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=97bf844f-f4bd-4a41-b734-9a294b506b02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:8f:42,bridge_name='br-int',has_traffic_filtering=True,id=c07fafbf-3e88-4dfa-9c41-ad99ee82416e,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc07fafbf-3e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG os_vif [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:8f:42,bridge_name='br-int',has_traffic_filtering=True,id=c07fafbf-3e88-4dfa-9c41-ad99ee82416e,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc07fafbf-3e') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d69a897-fa1b-5944-8abd-d4664af31622', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc07fafbf-3e, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc07fafbf-3e, col_values=(('qos', UUID('45eb3328-521d-476f-9674-6ed223498eb1')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc07fafbf-3e, col_values=(('external_ids', {'iface-id': 'c07fafbf-3e88-4dfa-9c41-ad99ee82416e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:8f:42', 'vm-uuid': '97bf844f-f4bd-4a41-b734-9a294b506b02'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:51 user nova-compute[75453]: INFO os_vif [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:8f:42,bridge_name='br-int',has_traffic_filtering=True,id=c07fafbf-3e88-4dfa-9c41-ad99ee82416e,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc07fafbf-3e')
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:50:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No VIF found with MAC fa:16:3e:87:8f:42, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:50:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received event network-vif-plugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:50:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] Acquiring lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:50:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:50:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:50:52 user nova-compute[75453]: DEBUG nova.compute.manager [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] No waiting events found dispatching network-vif-plugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:50:52 user nova-compute[75453]: WARNING nova.compute.manager [req-825e4e19-23f4-4430-95a5-c0fb3a30f2e8 req-9bdf7748-2499-4558-819c-c2a74d07fa28 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received unexpected event network-vif-plugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance with vm_state building and task_state spawning.
Nov 28 14:50:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:50:54 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Instance spawned successfully.
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:50:54 user nova-compute[75453]: INFO nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 28 14:50:54 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:50:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received event network-vif-plugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:50:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] Acquiring lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:50:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:50:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:50:55 user nova-compute[75453]: DEBUG nova.compute.manager [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] No waiting events found dispatching network-vif-plugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:50:55 user nova-compute[75453]: WARNING nova.compute.manager [req-93f50e9e-83ec-43ba-a54e-c326b1e561c8 req-52e96a94-0b6c-4b7f-866d-525549d29113 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received unexpected event network-vif-plugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance with vm_state building and task_state spawning.
Nov 28 14:50:55 user nova-compute[75453]: INFO nova.compute.manager [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Took 12.02 seconds to build instance.
Nov 28 14:50:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ab56d586-2f9e-44a1-8d4d-ef3e140b75e4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.112s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:50:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:50:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:50:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:50:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:50:58 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:50:58 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 97bf844f-f4bd-4a41-b734-9a294b506b02 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:50:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:50:59 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updating instance_info_cache with network_info: [{"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:50:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:50:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:50:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:50:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:51:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:51:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:51:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:51:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:51:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:51:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:51:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:51:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:51:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:51:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:51:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:51:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:51:47 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:51:51 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:51:51 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:51:51 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=25.025497436523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:51:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:51:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:51:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:51:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:51:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:51:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 97bf844f-f4bd-4a41-b734-9a294b506b02 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updating instance_info_cache with network_info: [{"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:52:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:52:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:52:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:52:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:52:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:52:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:52:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:52:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:52:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:52:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:52:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:52:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:22 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:52:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:52:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:52:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:52:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:52:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received event network-changed-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:52:33 user nova-compute[75453]: DEBUG nova.compute.manager [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Refreshing instance network info cache due to event network-changed-c07fafbf-3e88-4dfa-9c41-ad99ee82416e. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:52:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] Acquiring lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:52:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] Acquired lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:52:33 user nova-compute[75453]: DEBUG nova.network.neutron [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Refreshing network info cache for port c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:52:34 user nova-compute[75453]: DEBUG nova.network.neutron [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updated VIF entry in instance network info cache for port c07fafbf-3e88-4dfa-9c41-ad99ee82416e. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:52:34 user nova-compute[75453]: DEBUG nova.network.neutron [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updating instance_info_cache with network_info: [{"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:52:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4a96ad83-e2fa-4748-aa19-27af8055aef5 req-5b12bcbf-f8b1-423f-92a3-1ee1f22324d8 service nova] Releasing lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:52:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:52:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:52:40 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:52:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:52:40 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:52:40 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:52:40 user nova-compute[75453]: INFO nova.compute.claims [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Claim successful on node user
Nov 28 14:52:41 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:52:41 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:52:41 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:52:41 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:52:41 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:52:41 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:52:41 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:52:41 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:52:41 user nova-compute[75453]: INFO nova.virt.block_device [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Booting with volume snapshot 1bdf9689-6c9a-4597-a31c-2c601d2f44a4 at /dev/vda
Nov 28 14:52:41 user nova-compute[75453]: DEBUG nova.policy [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:52:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:41 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Successfully created port: d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Successfully updated port: d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquired lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received event network-changed-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG nova.compute.manager [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Refreshing instance network info cache due to event network-changed-d0fc3390-81a3-48b9-9fdf-c92a412e65af. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] Acquiring lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG nova.network.neutron [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Updating instance_info_cache with network_info: [{"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Releasing lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Instance network_info: |[{"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] Acquired lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:52:42 user nova-compute[75453]: DEBUG nova.network.neutron [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Refreshing network info cache for port d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:52:43 user nova-compute[75453]: DEBUG nova.network.neutron [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Updated VIF entry in instance network info cache for port d0fc3390-81a3-48b9-9fdf-c92a412e65af. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:52:43 user nova-compute[75453]: DEBUG nova.network.neutron [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Updating instance_info_cache with network_info: [{"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:52:43 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-628ab444-2c3f-48d6-b91c-d8afd3ab0527 req-61de41ed-d610-4eee-827b-93bf40b41818 service nova] Releasing lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:52:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:43 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:44 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG os_brick.utils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab39557-87c5-4227-a202-190eeaab7d46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[db70072e-bb5a-46b0-bba1-88acac33c5a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[00013544-b02b-4029-b1f5-b68798daa6fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a58106-a5cd-439c-93c3-e0503eaee232]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:52:47 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:52:47 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c97f6d-cb1b-4888-b53c-d486790da3d3]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG os_brick.utils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:52:47 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Updating existing volume attachment record: 613adad1-977e-46cb-a3e3-6abe24b55b60 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:52:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_power_states {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:48 user nova-compute[75453]: WARNING nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Nov 28 14:52:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 97bf844f-f4bd-4a41-b734-9a294b506b02 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:52:48 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 14:52:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "97bf844f-f4bd-4a41-b734-9a294b506b02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:52:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:52:48 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:52:49 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:52:49 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:51 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:52:51 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:52:51 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.024250030517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:52:51 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:52:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:52:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:52:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:52:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:52:52 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:52:52 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:52:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:52:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:52:53 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Creating image(s)
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Ensure instance console log exists: /opt/stack/data/nova/instances/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Start _get_guest_xml network_info=[{"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T14:52:35Z,direct_url=<?>,disk_format='qcow2',id=fc4ac2e7-ac9e-49c6-9a99-4b2140d2b7d7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-307805741',owner='193290c25f24467eac18c8a58e647834',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T14:52:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '613adad1-977e-46cb-a3e3-6abe24b55b60', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSuUXCDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b98cbd8-7fc1-4f2b-8153-ead8065d0b89', 'attached_at': '', 'detached_at': '', 'volume_id': '93ecc49b-98ee-4820-bcd0-2138bc209071', 'serial': '93ecc49b-98ee-4820-bcd0-2138bc209071'}, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:52:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:52:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T14:52:35Z,direct_url=<?>,disk_format='qcow2',id=fc4ac2e7-ac9e-49c6-9a99-4b2140d2b7d7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-307805741',owner='193290c25f24467eac18c8a58e647834',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T14:52:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSuUXCDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:52:53 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:52:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:52:53 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:52:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:52:53 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:52:53 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ea1f13-85f7-423c-a51a-682989c00d68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:52:54 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d74c668-9e3e-4d40-86de-d9804941ddec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071] added
Nov 28 14:52:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[58db89c9-2678-491e-a51c-1e94758df157]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0c8c34-ca78-48b9-89bc-56a194a70acb]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZSuUXCDT {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZSuUXCDT" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c49f937-7e8c-425f-a34a-3b244d6bfdb1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZSuUXCDT'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063dc0a-da48-44fa-8240-b34ac3bb1ccc]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb9bea-8734-4dd2-94c0-1625e625382c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:52:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:52:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba91239-57fc-43d9-ae9f-5b3d8c076e12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071, portal: 172.16.0.220,3260]
Nov 28 14:52:54 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071, portal: 172.16.0.220,3260] successful.
Nov 28 14:52:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[804234f1-70ef-4fd6-adb3-f7f9158b398b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c575bad4-6f0f-4e22-9105-f88c028086fb]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:52:54 user nova-compute[75453]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 (non-flash)
Nov 28 14:52:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:52:54 user nova-compute[75453]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 (non-flash)
Nov 28 14:52:54 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec348e1-250d-464e-a69c-65d92cd84f55]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:52:54 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSuUXCDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23762346566626465', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762346566626465', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2088713378',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2088713378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2088713378',id=49,image_ref='fc4ac2e7-ac9e-49c6-9a99-4b2140d2b7d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYcGyCbGqITV7wJeMLHH7QJ73kzrnxM0QBLIPVHv6nZ3bKD95lM0KOLMPNjP+dLAiN0+UyZuKFbYCMWbEqU4RucVMSugFyioGc5mYizH3C7i2T9twWCpfWIJCmTBFLTnQ==',key_name='tempest-keypair-1929093933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-qjgs0rd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-930393037',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=6b98cbd8-7fc1-4f2b-8153-ead8065d0b89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:85:ec,bridge_name='br-int',has_traffic_filtering=True,id=d0fc3390-81a3-48b9-9fdf-c92a412e65af,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fc3390-81') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.objects.instance [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:52:55 user nova-compute[75453]:   <uuid>6b98cbd8-7fc1-4f2b-8153-ead8065d0b89</uuid>
Nov 28 14:52:55 user nova-compute[75453]:   <name>instance-00000031</name>
Nov 28 14:52:55 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:52:55 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:52:55 user nova-compute[75453]:   <metadata>
Nov 28 14:52:55 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:52:55 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:52:55 user nova-compute[75453]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2088713378</nova:name>
Nov 28 14:52:55 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:52:53</nova:creationTime>
Nov 28 14:52:55 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:52:55 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:52:55 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:52:55 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:52:55 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:52:55 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:52:55 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:52:55 user nova-compute[75453]:       <nova:owner>
Nov 28 14:52:55 user nova-compute[75453]:         <nova:user uuid="ff4761ea9f664afd889cdcbda34787ad">tempest-TestVolumeBootPattern-930393037-project-member</nova:user>
Nov 28 14:52:55 user nova-compute[75453]:         <nova:project uuid="193290c25f24467eac18c8a58e647834">tempest-TestVolumeBootPattern-930393037</nova:project>
Nov 28 14:52:55 user nova-compute[75453]:       </nova:owner>
Nov 28 14:52:55 user nova-compute[75453]:       <nova:root type="image" uuid="fc4ac2e7-ac9e-49c6-9a99-4b2140d2b7d7"/>
Nov 28 14:52:55 user nova-compute[75453]:       <nova:ports>
Nov 28 14:52:55 user nova-compute[75453]:         <nova:port uuid="d0fc3390-81a3-48b9-9fdf-c92a412e65af">
Nov 28 14:52:55 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 14:52:55 user nova-compute[75453]:         </nova:port>
Nov 28 14:52:55 user nova-compute[75453]:       </nova:ports>
Nov 28 14:52:55 user nova-compute[75453]:     </nova:instance>
Nov 28 14:52:55 user nova-compute[75453]:   </metadata>
Nov 28 14:52:55 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:52:55 user nova-compute[75453]:     <system>
Nov 28 14:52:55 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:52:55 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:52:55 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:52:55 user nova-compute[75453]:       <entry name="serial">6b98cbd8-7fc1-4f2b-8153-ead8065d0b89</entry>
Nov 28 14:52:55 user nova-compute[75453]:       <entry name="uuid">6b98cbd8-7fc1-4f2b-8153-ead8065d0b89</entry>
Nov 28 14:52:55 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:52:55 user nova-compute[75453]:     </system>
Nov 28 14:52:55 user nova-compute[75453]:   </sysinfo>
Nov 28 14:52:55 user nova-compute[75453]:   <os>
Nov 28 14:52:55 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:52:55 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:52:55 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:52:55 user nova-compute[75453]:   </os>
Nov 28 14:52:55 user nova-compute[75453]:   <features>
Nov 28 14:52:55 user nova-compute[75453]:     <acpi/>
Nov 28 14:52:55 user nova-compute[75453]:     <apic/>
Nov 28 14:52:55 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:52:55 user nova-compute[75453]:   </features>
Nov 28 14:52:55 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:52:55 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:52:55 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:52:55 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:52:55 user nova-compute[75453]:   </clock>
Nov 28 14:52:55 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:52:55 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:52:55 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:52:55 user nova-compute[75453]:   </cpu>
Nov 28 14:52:55 user nova-compute[75453]:   <devices>
Nov 28 14:52:55 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:52:55 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:52:55 user nova-compute[75453]:       <source dev="/dev/sdc"/>
Nov 28 14:52:55 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:52:55 user nova-compute[75453]:       <serial>93ecc49b-98ee-4820-bcd0-2138bc209071</serial>
Nov 28 14:52:55 user nova-compute[75453]:     </disk>
Nov 28 14:52:55 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:52:55 user nova-compute[75453]:       <mac address="fa:16:3e:c7:85:ec"/>
Nov 28 14:52:55 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:52:55 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:52:55 user nova-compute[75453]:       <target dev="tapd0fc3390-81"/>
Nov 28 14:52:55 user nova-compute[75453]:     </interface>
Nov 28 14:52:55 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:52:55 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89/console.log" append="off"/>
Nov 28 14:52:55 user nova-compute[75453]:     </serial>
Nov 28 14:52:55 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:52:55 user nova-compute[75453]:     <video>
Nov 28 14:52:55 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:52:55 user nova-compute[75453]:     </video>
Nov 28 14:52:55 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:52:55 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:52:55 user nova-compute[75453]:     </rng>
Nov 28 14:52:55 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:52:55 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:52:55 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:52:55 user nova-compute[75453]:     </memballoon>
Nov 28 14:52:55 user nova-compute[75453]:   </devices>
Nov 28 14:52:55 user nova-compute[75453]: </domain>
Nov 28 14:52:55 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2088713378',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2088713378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2088713378',id=49,image_ref='fc4ac2e7-ac9e-49c6-9a99-4b2140d2b7d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYcGyCbGqITV7wJeMLHH7QJ73kzrnxM0QBLIPVHv6nZ3bKD95lM0KOLMPNjP+dLAiN0+UyZuKFbYCMWbEqU4RucVMSugFyioGc5mYizH3C7i2T9twWCpfWIJCmTBFLTnQ==',key_name='tempest-keypair-1929093933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-qjgs0rd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-930393037',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=6b98cbd8-7fc1-4f2b-8153-ead8065d0b89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:85:ec,bridge_name='br-int',has_traffic_filtering=True,id=d0fc3390-81a3-48b9-9fdf-c92a412e65af,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fc3390-81') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG os_vif [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:85:ec,bridge_name='br-int',has_traffic_filtering=True,id=d0fc3390-81a3-48b9-9fdf-c92a412e65af,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fc3390-81') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06a153b5-307c-541a-96e7-f9a8520f5f78', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0fc3390-81, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0fc3390-81, col_values=(('qos', UUID('1bfc93da-b082-4e85-bf51-f1ffc4143f57')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0fc3390-81, col_values=(('external_ids', {'iface-id': 'd0fc3390-81a3-48b9-9fdf-c92a412e65af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:85:ec', 'vm-uuid': '6b98cbd8-7fc1-4f2b-8153-ead8065d0b89'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:55 user nova-compute[75453]: INFO os_vif [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:85:ec,bridge_name='br-int',has_traffic_filtering=True,id=d0fc3390-81a3-48b9-9fdf-c92a412e65af,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fc3390-81')
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:52:55 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No VIF found with MAC fa:16:3e:c7:85:ec, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received event network-vif-plugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] Acquiring lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG nova.compute.manager [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] No waiting events found dispatching network-vif-plugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:52:56 user nova-compute[75453]: WARNING nova.compute.manager [req-c7f8717c-5d7b-4b32-82f9-ab1b7494144c req-c6ca3aad-6570-4bd8-b034-ac15b5e0ae56 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received unexpected event network-vif-plugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance with vm_state building and task_state spawning.
Nov 28 14:52:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:52:58 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Instance spawned successfully.
Nov 28 14:52:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:52:58 user nova-compute[75453]: INFO nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Took 4.85 seconds to spawn the instance on the hypervisor.
Nov 28 14:52:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:52:58 user nova-compute[75453]: INFO nova.compute.manager [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Took 18.03 seconds to build instance.
Nov 28 14:52:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received event network-vif-plugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] Acquiring lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG nova.compute.manager [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] No waiting events found dispatching network-vif-plugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:52:58 user nova-compute[75453]: WARNING nova.compute.manager [req-aae528c4-ec68-4ab9-814f-057125b6fbdb req-419c0e33-e541-46c2-8029-6b861cfc47cb service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received unexpected event network-vif-plugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance with vm_state active and task_state None.
Nov 28 14:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-ac46b4b7-ac70-4b1e-948f-49511183e649 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.119s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.914s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:52:58 user nova-compute[75453]: INFO nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 28 14:52:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:53:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:53:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:53:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:53:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:53:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:53:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:53:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:53:02 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:53:02 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 97bf844f-f4bd-4a41-b734-9a294b506b02 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:53:03 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updating instance_info_cache with network_info: [{"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:53:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:53:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:53:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:53:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:53:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:53:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:53:46 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:53:49 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:53:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:53:52 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:53:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:53:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:53:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:53:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:53:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:53:52 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:53:52 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:53:52 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:53:52 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.02288055419922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:53:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:53:52 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:53:53 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:53:53 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:53:53 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:53:53 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:53:53 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:53:53 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:53:53 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:53:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:53:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:53:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:53:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:53:55 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:54:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:04 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:54:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:54:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:54:04 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:54:05 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Updating instance_info_cache with network_info: [{"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:54:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:54:05 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:54:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:54:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:54:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:54:23 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received event network-changed-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:54:31 user nova-compute[75453]: DEBUG nova.compute.manager [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Refreshing instance network info cache due to event network-changed-d0fc3390-81a3-48b9-9fdf-c92a412e65af. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:54:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] Acquiring lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:54:31 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] Acquired lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:54:31 user nova-compute[75453]: DEBUG nova.network.neutron [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Refreshing network info cache for port d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Updated VIF entry in instance network info cache for port d0fc3390-81a3-48b9-9fdf-c92a412e65af. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG nova.network.neutron [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Updating instance_info_cache with network_info: [{"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e11922cb-c67c-4cf1-8bc0-564dc46f4dd7 req-37b83c8f-618e-4638-a57f-2e4be26d643f service nova] Releasing lock "refresh_cache-6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:54:32 user nova-compute[75453]: INFO nova.compute.manager [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Terminating instance
Nov 28 14:54:32 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received event network-vif-unplugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] Acquiring lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] No waiting events found dispatching network-vif-unplugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG nova.compute.manager [req-cfec8f74-5b11-486e-b0cb-3001f14a5d9f req-398df52f-bafc-4748-bdba-f7e11e0d5ac9 service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received event network-vif-unplugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:54:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Instance destroyed successfully.
Nov 28 14:54:33 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'resources' on Instance uuid 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2088713378',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2088713378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2088713378',id=49,image_ref='fc4ac2e7-ac9e-49c6-9a99-4b2140d2b7d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYcGyCbGqITV7wJeMLHH7QJ73kzrnxM0QBLIPVHv6nZ3bKD95lM0KOLMPNjP+dLAiN0+UyZuKFbYCMWbEqU4RucVMSugFyioGc5mYizH3C7i2T9twWCpfWIJCmTBFLTnQ==',key_name='tempest-keypair-1929093933',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:52:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-qjgs0rd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-930393037',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=6b98cbd8-7fc1-4f2b-8153-ead8065d0b89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "address": "fa:16:3e:c7:85:ec", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fc3390-81", "ovs_interfaceid": "d0fc3390-81a3-48b9-9fdf-c92a412e65af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:85:ec,bridge_name='br-int',has_traffic_filtering=True,id=d0fc3390-81a3-48b9-9fdf-c92a412e65af,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fc3390-81') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_vif [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:85:ec,bridge_name='br-int',has_traffic_filtering=True,id=d0fc3390-81a3-48b9-9fdf-c92a412e65af,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fc3390-81') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0fc3390-81, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bfc93da-b082-4e85-bf51-f1ffc4143f57) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:54:33 user nova-compute[75453]: INFO os_vif [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:85:ec,bridge_name='br-int',has_traffic_filtering=True,id=d0fc3390-81a3-48b9-9fdf-c92a412e65af,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fc3390-81')
Nov 28 14:54:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSuUXCDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:54:33 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea4faa-9ba1-4aa1-ab86-5174b61ad706]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:54:33 user nova-compute[75453]: No targets found.
Nov 28 14:54:33 user nova-compute[75453]: iSNS:
Nov 28 14:54:33 user nova-compute[75453]: No targets found.
Nov 28 14:54:33 user nova-compute[75453]: STATIC:
Nov 28 14:54:33 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071
Nov 28 14:54:33 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:54:33 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:54:33 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171
Nov 28 14:54:33 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:54:33 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:54:33 user nova-compute[75453]: FIRMWARE:
Nov 28 14:54:33 user nova-compute[75453]: No targets found.
Nov 28 14:54:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:54:33 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:54:33 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[78249b06-a902-4545-833a-bdaab701e8d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baaf8bf-fe4a-4d7b-a925-1f047827678d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:54:33 user nova-compute[75453]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 (non-flash)
Nov 28 14:54:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:54:33 user nova-compute[75453]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 (non-flash)
Nov 28 14:54:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02186fca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[86401550-2004-41f3-9e3b-88d4cfa7083c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308f08e-9927-4efd-8c08-e63ba135c581]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb0b2fb-38e2-4350-b832-b21627940fe5]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e508881c-0a47-4432-9ce5-0c70032c052f]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8dd7b6a6-7b4efbde5ab30028', '/dev/disk/by-id/scsi-23762346566626465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8dd7b6a6') {{(pid=86546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 14:54:33 user nova-compute[75453]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO8dd7b6a6-7b4efbde5ab30028
Nov 28 14:54:33 user nova-compute[75453]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23762346566626465
Nov 28 14:54:33 user nova-compute[75453]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_8dd7b6a6
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b54969-36bd-41cc-9b12-e2120a38981b]: (4, None) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f456869-1094-4928-bc89-327684abe168]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6685de78-7059-42b1-a435-e89ba49b7ab3]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071, portal: 172.16.0.220,3260]
Nov 28 14:54:33 user nova-compute[75453]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071, portal: 172.16.0.220,3260] successful.
Nov 28 14:54:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ecc49b-98ee-4820-bcd0-2138bc209071 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ac9765-b989-4073-86c3-4ad356c781cd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== disconnect_volume: return (298ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:54:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Deleting instance files /opt/stack/data/nova/instances/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89_del
Nov 28 14:54:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Deletion of /opt/stack/data/nova/instances/6b98cbd8-7fc1-4f2b-8153-ead8065d0b89_del complete
Nov 28 14:54:33 user nova-compute[75453]: INFO nova.compute.manager [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 28 14:54:33 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:54:33 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:54:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:34 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:54:34 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Took 0.72 seconds to deallocate network for instance.
Nov 28 14:54:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received event network-vif-plugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:54:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] Acquiring lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:54:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:54:34 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:54:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] No waiting events found dispatching network-vif-plugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:54:34 user nova-compute[75453]: WARNING nova.compute.manager [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received unexpected event network-vif-plugged-d0fc3390-81a3-48b9-9fdf-c92a412e65af for instance with vm_state active and task_state deleting.
Nov 28 14:54:34 user nova-compute[75453]: DEBUG nova.compute.manager [req-2335e08b-2626-4b3a-af06-c7b3e6518df2 req-0a662674-71ef-4283-bcf6-4f05130c678e service nova] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Received event network-vif-deleted-d0fc3390-81a3-48b9-9fdf-c92a412e65af {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:54:35 user nova-compute[75453]: INFO nova.compute.manager [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Took 0.76 seconds to detach 1 volumes for instance.
Nov 28 14:54:35 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89] Deleting volume: 93ecc49b-98ee-4820-bcd0-2138bc209071 {{(pid=75453) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 14:54:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:54:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:54:35 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:54:35 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:54:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:54:35 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Deleted allocations for instance 6b98cbd8-7fc1-4f2b-8153-ead8065d0b89
Nov 28 14:54:35 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b6221666-bcc3-4b71-9396-3539d809bdd7 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "6b98cbd8-7fc1-4f2b-8153-ead8065d0b89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.072s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:54:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:54:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:54:48 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:50 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:54:53 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:54:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:54:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:54:53 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:54:53 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:54:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:54:53 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:54:53 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9015MB free_disk=25.021991729736328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:54:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:54:53 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:54:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance 97bf844f-f4bd-4a41-b734-9a294b506b02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:54:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:54:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:54:54 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:54:54 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:54:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:54:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:54:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:54:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:54:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:55:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:55:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:55:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:55:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:55:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:55:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:55:06 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:55:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:55:06 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:55:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:55:06 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid 97bf844f-f4bd-4a41-b734-9a294b506b02 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:55:06 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updating instance_info_cache with network_info: [{"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:55:07 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-97bf844f-f4bd-4a41-b734-9a294b506b02" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:55:07 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:55:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:55:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:55:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "97bf844f-f4bd-4a41-b734-9a294b506b02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:55:26 user nova-compute[75453]: INFO nova.compute.manager [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Terminating instance
Nov 28 14:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received event network-vif-unplugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] Acquiring lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] No waiting events found dispatching network-vif-unplugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:55:26 user nova-compute[75453]: DEBUG nova.compute.manager [req-c355d953-7f21-4a00-9376-6b4e2faa3d88 req-9e9ec800-2061-475e-b1a5-e8741ae9a0c1 service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received event network-vif-unplugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:55:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Instance destroyed successfully.
Nov 28 14:55:27 user nova-compute[75453]: DEBUG nova.objects.instance [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'resources' on Instance uuid 97bf844f-f4bd-4a41-b734-9a294b506b02 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-358520062',display_name='tempest-TestVolumeBootPattern-volume-backed-server-358520062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-358520062',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhB2kJ20aciKhL9XO+yEcWexH9qTAOKavq0XBDXr6Xy+MdWT0FlTwKQDfAIRX1gg9yUaIqUoa/biZ3jVEhPDOL+0zGdQle1eLvjoUiGakKYViDdIuRtzlPgHCGb5H2PGA==',key_name='tempest-keypair-859234956',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-0dqxat0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=97bf844f-f4bd-4a41-b734-9a294b506b02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "address": "fa:16:3e:87:8f:42", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07fafbf-3e", "ovs_interfaceid": "c07fafbf-3e88-4dfa-9c41-ad99ee82416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:8f:42,bridge_name='br-int',has_traffic_filtering=True,id=c07fafbf-3e88-4dfa-9c41-ad99ee82416e,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc07fafbf-3e') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_vif [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:8f:42,bridge_name='br-int',has_traffic_filtering=True,id=c07fafbf-3e88-4dfa-9c41-ad99ee82416e,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc07fafbf-3e') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc07fafbf-3e, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45eb3328-521d-476f-9674-6ed223498eb1) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:55:27 user nova-compute[75453]: INFO os_vif [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:8f:42,bridge_name='br-int',has_traffic_filtering=True,id=c07fafbf-3e88-4dfa-9c41-ad99ee82416e,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc07fafbf-3e')
Nov 28 14:55:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knwTobSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:55:27 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[618ab386-36ea-4f8f-a195-716ae1743a71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:55:27 user nova-compute[75453]: No targets found.
Nov 28 14:55:27 user nova-compute[75453]: iSNS:
Nov 28 14:55:27 user nova-compute[75453]: No targets found.
Nov 28 14:55:27 user nova-compute[75453]: STATIC:
Nov 28 14:55:27 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171
Nov 28 14:55:27 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:55:27 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:55:27 user nova-compute[75453]: FIRMWARE:
Nov 28 14:55:27 user nova-compute[75453]: No targets found.
Nov 28 14:55:27 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:55:27 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:55:27 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0b08e3-c4cd-4037-9d2f-a8e12f1b460d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bed5ab-dc12-4adb-a2c1-a8ef97ead645]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:55:27 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 (non-flash)
Nov 28 14:55:27 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02185b7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c388bbbe-6d52-43de-ad14-301bd8cc9662]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d75845e-0b2e-4933-957e-f2758b265a34]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[94787f97-feec-4edd-8453-d0bc3494b978]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8b559f-8194-4e8c-9ed9-6baba30f923c]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3931eab0', '/dev/disk/by-id/scsi-1SCST_BIO3931eab0-6ce61982a5487ae2', '/dev/disk/by-id/scsi-23663653631393832') {{(pid=86546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e9ec87-5eca-49a8-bf3f-a6a7cc5d0ebe]: (4, None) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3b2968-e2fb-43f1-9dfd-2aa5670cecc1]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe311f33-8953-4f89-91f8-bcf628f5b0e0]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171, portal: 172.16.0.220,3260]
Nov 28 14:55:27 user nova-compute[75453]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171, portal: 172.16.0.220,3260] successful.
Nov 28 14:55:27 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa43a66e-7d14-41b9-8486-7a6102750171 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[20193b64-e3c2-49da-8980-a9c12915148e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== disconnect_volume: return (318ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:55:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Deleting instance files /opt/stack/data/nova/instances/97bf844f-f4bd-4a41-b734-9a294b506b02_del
Nov 28 14:55:27 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Deletion of /opt/stack/data/nova/instances/97bf844f-f4bd-4a41-b734-9a294b506b02_del complete
Nov 28 14:55:27 user nova-compute[75453]: INFO nova.compute.manager [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 28 14:55:27 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:55:27 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:55:28 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:55:28 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Took 0.76 seconds to deallocate network for instance.
Nov 28 14:55:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received event network-vif-plugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:55:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] Acquiring lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:55:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:55:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:55:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] No waiting events found dispatching network-vif-plugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:55:28 user nova-compute[75453]: WARNING nova.compute.manager [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received unexpected event network-vif-plugged-c07fafbf-3e88-4dfa-9c41-ad99ee82416e for instance with vm_state active and task_state deleting.
Nov 28 14:55:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-d7ef481b-6511-49e2-8362-e060154d3f34 req-59d07dbb-be17-4859-b85a-42e4a90652cd service nova] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Received event network-vif-deleted-c07fafbf-3e88-4dfa-9c41-ad99ee82416e {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:55:29 user nova-compute[75453]: INFO nova.compute.manager [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Took 0.80 seconds to detach 1 volumes for instance.
Nov 28 14:55:29 user nova-compute[75453]: DEBUG nova.compute.manager [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: 97bf844f-f4bd-4a41-b734-9a294b506b02] Deleting volume: fa43a66e-7d14-41b9-8486-7a6102750171 {{(pid=75453) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 14:55:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:55:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:55:29 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:55:29 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:55:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:55:29 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Deleted allocations for instance 97bf844f-f4bd-4a41-b734-9a294b506b02
Nov 28 14:55:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-a415a774-60df-47eb-8eff-405113022f94 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "97bf844f-f4bd-4a41-b734-9a294b506b02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.207s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:55:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:55:42 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:55:47 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:55:49 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:55:52 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:55:52 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:55:54 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:55:54 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:55:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9150MB free_disk=25.021175384521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:55:54 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:55:55 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:55:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:55:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:55:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:55:56 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:55:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:55:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:56:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:56:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:56:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:07 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:08 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:08 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:56:08 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:56:08 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:56:12 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:56:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:56:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:56:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:24 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:56:26 user nova-compute[75453]: INFO nova.compute.claims [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Claim successful on node user
Nov 28 14:56:26 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG nova.network.neutron [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:56:26 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:56:26 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG nova.policy [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:56:26 user nova-compute[75453]: INFO nova.virt.block_device [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Booting with volume 517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 at /dev/vda
Nov 28 14:56:26 user nova-compute[75453]: DEBUG os_brick.utils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a2e02b-248c-48f9-834a-2d3fad2b0d13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3f204f-727e-44a8-bcac-8973be39f15b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d788a-2fe9-4cfb-aa4e-e26156889437]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70b7c84-1c61-4cca-8663-5b01a36158ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:26 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:56:27 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:56:27 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e37a2d-607c-45d2-92e9-60800ad3a968]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG os_brick.utils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updating existing volume attachment record: 6b7790c4-7661-4310-ac21-6e43e597b758 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:27 user nova-compute[75453]: DEBUG nova.network.neutron [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Successfully created port: 44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Successfully updated port: 44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquired lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received event network-changed-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG nova.compute.manager [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Refreshing instance network info cache due to event network-changed-44592762-39a0-44d6-b89b-326e161d98cf. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] Acquiring lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updating instance_info_cache with network_info: [{"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Releasing lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Instance network_info: |[{"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] Acquired lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:56:28 user nova-compute[75453]: DEBUG nova.network.neutron [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Refreshing network info cache for port 44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:56:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updated VIF entry in instance network info cache for port 44592762-39a0-44d6-b89b-326e161d98cf. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:56:29 user nova-compute[75453]: DEBUG nova.network.neutron [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updating instance_info_cache with network_info: [{"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:56:29 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-4197109a-1303-42fa-aeb3-037ad05318ae req-01adc7c3-c31f-4d26-83f7-fcff9248b002 service nova] Releasing lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:56:32 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:56:33 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Creating image(s)
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Ensure instance console log exists: /opt/stack/data/nova/instances/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Start _get_guest_xml network_info=[{"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6b7790c4-7661-4310-ac21-6e43e597b758', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgcZhKtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc8dd39b-4fe1-440c-ac5a-e4594fb548dd', 'attached_at': '', 'detached_at': '', 'volume_id': '517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'serial': '517a0ea3-4ec6-4a12-b8fb-b2241ad7a574'}, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:56:33 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:56:33 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgcZhKtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:56:33 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:56:33 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:56:33 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd89735c-af2f-408e-a21d-d39631d43f47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:56:33 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead3972c-29d5-4ac7-b1ce-fd3974998bed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574] added
Nov 28 14:56:33 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[400a75fc-f31b-425a-8d9c-44850160ea2a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfc05ac-3263-41be-a961-320aab7f94d5]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgcZhKtd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgcZhKtd" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac09234-0edf-4cfa-9c60-6b27fb04c191]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vgcZhKtd'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:33 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ee431-a36a-43a4-b9f9-e69127463ab3]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[29868f92-cfff-4fc0-91da-e3e036b502c9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:56:34 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:56:34 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:56:34 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:56:34 user nova-compute[75453]: 
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc3758b-d719-44bc-8b7f-71d22c7cdd7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260]
Nov 28 14:56:34 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260] successful.
Nov 28 14:56:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae9077-9345-48dc-a74c-21e9cb5b2094]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5b5912-0fd3-43d0-83f0-c21fd3b6843a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 14:56:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 14:56:34 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a5cc31-fea9-4d7b-8409-266b2ef06112]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:56:34 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgcZhKtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26261393631306566', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261393631306566', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:56:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1490882601',display_name='tempest-TestVolumeBootPattern-server-1490882601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1490882601',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ==',key_name='tempest-TestVolumeBootPattern-498211364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-qwdb1mhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:56:27Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=fc8dd39b-4fe1-440c-ac5a-e4594fb548dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:c3,bridge_name='br-int',has_traffic_filtering=True,id=44592762-39a0-44d6-b89b-326e161d98cf,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44592762-39') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.objects.instance [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'pci_devices' on Instance uuid fc8dd39b-4fe1-440c-ac5a-e4594fb548dd {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:56:35 user nova-compute[75453]:   <uuid>fc8dd39b-4fe1-440c-ac5a-e4594fb548dd</uuid>
Nov 28 14:56:35 user nova-compute[75453]:   <name>instance-00000032</name>
Nov 28 14:56:35 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:56:35 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:56:35 user nova-compute[75453]:   <metadata>
Nov 28 14:56:35 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:56:35 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:56:35 user nova-compute[75453]:       <nova:name>tempest-TestVolumeBootPattern-server-1490882601</nova:name>
Nov 28 14:56:35 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:56:33</nova:creationTime>
Nov 28 14:56:35 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:56:35 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:56:35 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:56:35 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:56:35 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:56:35 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:56:35 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:56:35 user nova-compute[75453]:       <nova:owner>
Nov 28 14:56:35 user nova-compute[75453]:         <nova:user uuid="ff4761ea9f664afd889cdcbda34787ad">tempest-TestVolumeBootPattern-930393037-project-member</nova:user>
Nov 28 14:56:35 user nova-compute[75453]:         <nova:project uuid="193290c25f24467eac18c8a58e647834">tempest-TestVolumeBootPattern-930393037</nova:project>
Nov 28 14:56:35 user nova-compute[75453]:       </nova:owner>
Nov 28 14:56:35 user nova-compute[75453]:       <nova:ports>
Nov 28 14:56:35 user nova-compute[75453]:         <nova:port uuid="44592762-39a0-44d6-b89b-326e161d98cf">
Nov 28 14:56:35 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 14:56:35 user nova-compute[75453]:         </nova:port>
Nov 28 14:56:35 user nova-compute[75453]:       </nova:ports>
Nov 28 14:56:35 user nova-compute[75453]:     </nova:instance>
Nov 28 14:56:35 user nova-compute[75453]:   </metadata>
Nov 28 14:56:35 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:56:35 user nova-compute[75453]:     <system>
Nov 28 14:56:35 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:56:35 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:56:35 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:56:35 user nova-compute[75453]:       <entry name="serial">fc8dd39b-4fe1-440c-ac5a-e4594fb548dd</entry>
Nov 28 14:56:35 user nova-compute[75453]:       <entry name="uuid">fc8dd39b-4fe1-440c-ac5a-e4594fb548dd</entry>
Nov 28 14:56:35 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:56:35 user nova-compute[75453]:     </system>
Nov 28 14:56:35 user nova-compute[75453]:   </sysinfo>
Nov 28 14:56:35 user nova-compute[75453]:   <os>
Nov 28 14:56:35 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:56:35 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:56:35 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:56:35 user nova-compute[75453]:   </os>
Nov 28 14:56:35 user nova-compute[75453]:   <features>
Nov 28 14:56:35 user nova-compute[75453]:     <acpi/>
Nov 28 14:56:35 user nova-compute[75453]:     <apic/>
Nov 28 14:56:35 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:56:35 user nova-compute[75453]:   </features>
Nov 28 14:56:35 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:56:35 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:56:35 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:56:35 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:56:35 user nova-compute[75453]:   </clock>
Nov 28 14:56:35 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:56:35 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:56:35 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:56:35 user nova-compute[75453]:   </cpu>
Nov 28 14:56:35 user nova-compute[75453]:   <devices>
Nov 28 14:56:35 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:56:35 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:56:35 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:56:35 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:56:35 user nova-compute[75453]:       <serial>517a0ea3-4ec6-4a12-b8fb-b2241ad7a574</serial>
Nov 28 14:56:35 user nova-compute[75453]:     </disk>
Nov 28 14:56:35 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:56:35 user nova-compute[75453]:       <mac address="fa:16:3e:ae:37:c3"/>
Nov 28 14:56:35 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:56:35 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:56:35 user nova-compute[75453]:       <target dev="tap44592762-39"/>
Nov 28 14:56:35 user nova-compute[75453]:     </interface>
Nov 28 14:56:35 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:56:35 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd/console.log" append="off"/>
Nov 28 14:56:35 user nova-compute[75453]:     </serial>
Nov 28 14:56:35 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:56:35 user nova-compute[75453]:     <video>
Nov 28 14:56:35 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:56:35 user nova-compute[75453]:     </video>
Nov 28 14:56:35 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:56:35 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:56:35 user nova-compute[75453]:     </rng>
Nov 28 14:56:35 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:56:35 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:56:35 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:56:35 user nova-compute[75453]:     </memballoon>
Nov 28 14:56:35 user nova-compute[75453]:   </devices>
Nov 28 14:56:35 user nova-compute[75453]: </domain>
Nov 28 14:56:35 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:56:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1490882601',display_name='tempest-TestVolumeBootPattern-server-1490882601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1490882601',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ==',key_name='tempest-TestVolumeBootPattern-498211364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-qwdb1mhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:56:27Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=fc8dd39b-4fe1-440c-ac5a-e4594fb548dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:c3,bridge_name='br-int',has_traffic_filtering=True,id=44592762-39a0-44d6-b89b-326e161d98cf,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44592762-39') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG os_vif [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:c3,bridge_name='br-int',has_traffic_filtering=True,id=44592762-39a0-44d6-b89b-326e161d98cf,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44592762-39') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d015dc8-7070-5d44-8a30-41482a3d215d', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44592762-39, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44592762-39, col_values=(('qos', UUID('7d86bde1-ceb2-4aeb-ae78-15074aa47357')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44592762-39, col_values=(('external_ids', {'iface-id': '44592762-39a0-44d6-b89b-326e161d98cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:37:c3', 'vm-uuid': 'fc8dd39b-4fe1-440c-ac5a-e4594fb548dd'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:35 user nova-compute[75453]: INFO os_vif [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:c3,bridge_name='br-int',has_traffic_filtering=True,id=44592762-39a0-44d6-b89b-326e161d98cf,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44592762-39')
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:56:35 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No VIF found with MAC fa:16:3e:ae:37:c3, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:56:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received event network-vif-plugged-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:56:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] Acquiring lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:56:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:56:36 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:56:36 user nova-compute[75453]: DEBUG nova.compute.manager [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] No waiting events found dispatching network-vif-plugged-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:56:36 user nova-compute[75453]: WARNING nova.compute.manager [req-e1ae511d-60b0-4396-a07a-3a4d8564273c req-fada421a-98f8-47f3-a444-d14958985734 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received unexpected event network-vif-plugged-44592762-39a0-44d6-b89b-326e161d98cf for instance with vm_state building and task_state spawning.
Nov 28 14:56:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:37 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:56:38 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Instance spawned successfully.
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:56:38 user nova-compute[75453]: INFO nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received event network-vif-plugged-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] Acquiring lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG nova.compute.manager [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] No waiting events found dispatching network-vif-plugged-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:56:38 user nova-compute[75453]: WARNING nova.compute.manager [req-04374876-9f6a-4b5d-993e-dd76956a5ddd req-efc6dd01-aaa4-472d-b3ac-650d9ee5007b service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received unexpected event network-vif-plugged-44592762-39a0-44d6-b89b-326e161d98cf for instance with vm_state building and task_state spawning.
Nov 28 14:56:38 user nova-compute[75453]: INFO nova.compute.manager [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Took 12.35 seconds to build instance.
Nov 28 14:56:38 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-b725c3aa-2a90-457e-b593-618f2fed6544 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.443s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:56:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:56:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:56:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:56:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:56:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:51 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:52 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:56:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:56:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:56:54 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:56:54 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:56:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=25.011260986328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:56:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:56:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:56:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:56:58 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:56:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 14:57:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 14:57:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:05 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:05 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid fc8dd39b-4fe1-440c-ac5a-e4594fb548dd {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updating instance_info_cache with network_info: [{"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:57:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:57:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:24 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 14:57:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:57:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:57:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:57:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:57:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:53 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:53 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:53 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:57:54 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:57:54 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:57:54 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:57:54 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:57:54 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:57:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=25.010635375976562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:57:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:57:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:57:59 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:58:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:58:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:58:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:58:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:58:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:58:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:58:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:58:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:58:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:58:10 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 14:58:10 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid fc8dd39b-4fe1-440c-ac5a-e4594fb548dd {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:58:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updating instance_info_cache with network_info: [{"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:58:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:58:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 14:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:58:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:17 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received event network-changed-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG nova.compute.manager [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Refreshing instance network info cache due to event network-changed-44592762-39a0-44d6-b89b-326e161d98cf. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] Acquiring lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] Acquired lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG nova.network.neutron [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Refreshing network info cache for port 44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG nova.network.neutron [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updated VIF entry in instance network info cache for port 44592762-39a0-44d6-b89b-326e161d98cf. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG nova.network.neutron [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updating instance_info_cache with network_info: [{"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-908c9d9f-2ff1-468a-b488-254905236203 req-7f9d862a-1d13-4407-b7bc-4f4ac6340a40 service nova] Releasing lock "refresh_cache-fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:58:18 user nova-compute[75453]: INFO nova.compute.manager [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Terminating instance
Nov 28 14:58:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:19 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Instance destroyed successfully.
Nov 28 14:58:19 user nova-compute[75453]: DEBUG nova.objects.instance [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'resources' on Instance uuid fc8dd39b-4fe1-440c-ac5a-e4594fb548dd {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:56:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1490882601',display_name='tempest-TestVolumeBootPattern-server-1490882601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1490882601',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ==',key_name='tempest-TestVolumeBootPattern-498211364',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-qwdb1mhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:56:39Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=fc8dd39b-4fe1-440c-ac5a-e4594fb548dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "44592762-39a0-44d6-b89b-326e161d98cf", "address": "fa:16:3e:ae:37:c3", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44592762-39", "ovs_interfaceid": "44592762-39a0-44d6-b89b-326e161d98cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:37:c3,bridge_name='br-int',has_traffic_filtering=True,id=44592762-39a0-44d6-b89b-326e161d98cf,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44592762-39') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_vif [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:37:c3,bridge_name='br-int',has_traffic_filtering=True,id=44592762-39a0-44d6-b89b-326e161d98cf,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44592762-39') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44592762-39, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d86bde1-ceb2-4aeb-ae78-15074aa47357) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:58:19 user nova-compute[75453]: INFO os_vif [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:37:c3,bridge_name='br-int',has_traffic_filtering=True,id=44592762-39a0-44d6-b89b-326e161d98cf,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44592762-39')
Nov 28 14:58:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgcZhKtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:58:19 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1f569b-460a-4ab0-92c7-b33103810cb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 14:58:19 user nova-compute[75453]: No targets found.
Nov 28 14:58:19 user nova-compute[75453]: iSNS:
Nov 28 14:58:19 user nova-compute[75453]: No targets found.
Nov 28 14:58:19 user nova-compute[75453]: STATIC:
Nov 28 14:58:19 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574
Nov 28 14:58:19 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 14:58:19 user nova-compute[75453]:                 Iface Name: default
Nov 28 14:58:19 user nova-compute[75453]: FIRMWARE:
Nov 28 14:58:19 user nova-compute[75453]: No targets found.
Nov 28 14:58:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 14:58:19 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 14:58:19 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d245beb-9a17-4178-bb02-2fd5146bbef3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[17064acb-d0c6-4933-acc9-070c4323ad5f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 14:58:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 14:58:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02187de830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90ce638-e459-4f29-b9b4-e171228d5539]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7789080-2666-4825-88cf-620cc9b4aff4]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc49a87a-675a-4844-87cc-32fd595c1b59]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f985a58d-ee18-4bee-9adb-4d0401452ac9]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26261393631306566', '/dev/disk/by-id/scsi-1SCST_BIOe2eebf5f-ba9610ef170a6e76', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e2eebf5f') {{(pid=86546) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[89685bc8-8315-4536-87d0-3b08385b0249]: (4, None) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9041cc-3727-4362-8395-7f22c7f54cec]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[17030314-7183-4ea1-8a85-b5fdd3f1d4d0]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260]
Nov 28 14:58:19 user nova-compute[75453]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260] successful.
Nov 28 14:58:19 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6696addb-a03c-450f-b679-6e2f3b7a9ce0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== disconnect_volume: return (313ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 14:58:19 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Deleting instance files /opt/stack/data/nova/instances/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd_del
Nov 28 14:58:19 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Deletion of /opt/stack/data/nova/instances/fc8dd39b-4fe1-440c-ac5a-e4594fb548dd_del complete
Nov 28 14:58:19 user nova-compute[75453]: INFO nova.compute.manager [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 28 14:58:19 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 14:58:19 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received event network-vif-unplugged-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Acquiring lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] No waiting events found dispatching network-vif-unplugged-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received event network-vif-unplugged-44592762-39a0-44d6-b89b-326e161d98cf for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received event network-vif-plugged-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Acquiring lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] No waiting events found dispatching network-vif-plugged-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:58:20 user nova-compute[75453]: WARNING nova.compute.manager [req-8f7d1214-950b-4b67-88cd-810b10e3072e req-ed37c60f-ef59-4772-a790-dc6528199036 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received unexpected event network-vif-plugged-44592762-39a0-44d6-b89b-326e161d98cf for instance with vm_state active and task_state deleting.
Nov 28 14:58:20 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:58:20 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Took 0.68 seconds to deallocate network for instance.
Nov 28 14:58:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Received event network-vif-deleted-44592762-39a0-44d6-b89b-326e161d98cf {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:58:20 user nova-compute[75453]: INFO nova.compute.manager [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Neutron deleted interface 44592762-39a0-44d6-b89b-326e161d98cf; detaching it from the instance and deleting it from the info cache
Nov 28 14:58:20 user nova-compute[75453]: DEBUG nova.network.neutron [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:58:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-55494e18-ce15-49b5-a8ca-a3aa84e67495 req-beb71ec9-43c8-484d-bce3-a8cb3891ada2 service nova] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Detach interface failed, port_id=44592762-39a0-44d6-b89b-326e161d98cf, reason: Instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd could not be found. {{(pid=75453) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 14:58:21 user nova-compute[75453]: INFO nova.compute.manager [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: fc8dd39b-4fe1-440c-ac5a-e4594fb548dd] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 14:58:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:58:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:58:21 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:58:21 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:58:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:58:21 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Deleted allocations for instance fc8dd39b-4fe1-440c-ac5a-e4594fb548dd
Nov 28 14:58:21 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-c503e734-e1aa-4fa4-beea-bba8158a75d4 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "fc8dd39b-4fe1-440c-ac5a-e4594fb548dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.854s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:58:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:58:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:58:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:58:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:58:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:58:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:58:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:58:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:58:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:58:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:58:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:58:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:58:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:58:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:58:55 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:58:55 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:58:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9158MB free_disk=25.009807586669922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:58:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:58:55 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:58:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:58:55 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:58:56 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:58:56 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:58:56 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:58:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:58:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:59:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:59:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:59:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 14:59:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:59:08 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:59:08 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:59:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d78f7954-6146-4786-8d53-348e0489ba14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d78f7954-6146-4786-8d53-348e0489ba14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 14:59:10 user nova-compute[75453]: INFO nova.compute.claims [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Claim successful on node user
Nov 28 14:59:10 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 14:59:10 user nova-compute[75453]: DEBUG nova.network.neutron [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 14:59:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 14:59:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 14:59:10 user nova-compute[75453]: INFO nova.virt.block_device [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Booting with volume 517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 at /dev/vda
Nov 28 14:59:11 user nova-compute[75453]: DEBUG nova.policy [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG os_brick.utils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[06acbe61-d07d-4c41-87e2-f8e3c583a607]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a809f608-6eec-4992-8e3a-c230de3cebc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[74882e44-e71f-4c58-b682-e53f3dda500b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbe94da-11c0-4b00-b377-b481e4e92c04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 14:59:11 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[5913b22c-3a90-41cf-ace5-a0416674b8d7]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG os_brick.utils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updating existing volume attachment record: d5a767ff-fddd-42e7-a181-bd6721094591 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Skipping network cache update for instance because it is Building. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 14:59:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Successfully created port: 16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Successfully updated port: 16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquired lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received event network-changed-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.compute.manager [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Refreshing instance network info cache due to event network-changed-16083ebd-df26-40bd-a15a-a3ae1f2e6224. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] Acquiring lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.network.neutron [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updating instance_info_cache with network_info: [{"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Releasing lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Instance network_info: |[{"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] Acquired lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.network.neutron [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Refreshing network info cache for port 16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.network.neutron [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updated VIF entry in instance network info cache for port 16083ebd-df26-40bd-a15a-a3ae1f2e6224. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 14:59:12 user nova-compute[75453]: DEBUG nova.network.neutron [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updating instance_info_cache with network_info: [{"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 14:59:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-97c09e7e-1a6d-4b8c-9081-9471b7725e43 req-af1719e5-1664-4d19-9c6a-fe7bacae2d87 service nova] Releasing lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 14:59:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:59:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:59:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:59:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:59:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:59:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 14:59:20 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Creating image(s)
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Ensure instance console log exists: /opt/stack/data/nova/instances/d78f7954-6146-4786-8d53-348e0489ba14/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Start _get_guest_xml network_info=[{"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd5a767ff-fddd-42e7-a181-bd6721094591', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgcZhKtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd78f7954-6146-4786-8d53-348e0489ba14', 'attached_at': '', 'detached_at': '', 'volume_id': '517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'serial': '517a0ea3-4ec6-4a12-b8fb-b2241ad7a574'}, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 14:59:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:59:20 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgcZhKtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 14:59:20 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:59:20 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 14:59:20 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[db27ace2-4e37-442b-852f-8663b002ca78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 14:59:20 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f9158-6213-4ee9-9827-99a36c9f0041]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574] added
Nov 28 14:59:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a26bde-827f-4957-90de-e4accf57e24e]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b2442b-ffdb-4405-9b69-0ca3341b881a]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgcZhKtd {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgcZhKtd" returned: 0 in 0.021s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[3101e7f6-1e4c-43cc-bf1a-8a49eacc9afe]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vgcZhKtd'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce100573-3698-4db6-9f16-927167a60c81]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0823325-a13b-4352-a347-dee97d3fd816]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:59:20 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 14:59:20 user nova-compute[75453]:  {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:59:20 user nova-compute[75453]: WARNING os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 14:59:20 user nova-compute[75453]: 
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f98906-3117-46ef-9e6d-cd7019348ec1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260]
Nov 28 14:59:20 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260] successful.
Nov 28 14:59:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe51813-c1df-4413-b428-d67ffe565f2b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[35394f2b-f769-4349-b568-9b214df31ec7]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 14:59:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 14:59:20 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc19e4a-7d52-4a0f-92e7-372d3ea5c76a]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 14:59:20 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgcZhKtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26261393631306566', 'path': '/dev/sdb'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261393631306566', 'path': '/dev/sdb'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-352957172',display_name='tempest-TestVolumeBootPattern-server-352957172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-352957172',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ==',key_name='tempest-TestVolumeBootPattern-498211364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-v7aj8yhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:59:11Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=d78f7954-6146-4786-8d53-348e0489ba14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:4e,bridge_name='br-int',has_traffic_filtering=True,id=16083ebd-df26-40bd-a15a-a3ae1f2e6224,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16083ebd-df') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.objects.instance [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'pci_devices' on Instance uuid d78f7954-6146-4786-8d53-348e0489ba14 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] End _get_guest_xml xml=<domain type="kvm">
Nov 28 14:59:21 user nova-compute[75453]:   <uuid>d78f7954-6146-4786-8d53-348e0489ba14</uuid>
Nov 28 14:59:21 user nova-compute[75453]:   <name>instance-00000033</name>
Nov 28 14:59:21 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 14:59:21 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 14:59:21 user nova-compute[75453]:   <metadata>
Nov 28 14:59:21 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 14:59:21 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 14:59:21 user nova-compute[75453]:       <nova:name>tempest-TestVolumeBootPattern-server-352957172</nova:name>
Nov 28 14:59:21 user nova-compute[75453]:       <nova:creationTime>2023-11-28 14:59:20</nova:creationTime>
Nov 28 14:59:21 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 14:59:21 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 14:59:21 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 14:59:21 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 14:59:21 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 14:59:21 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 14:59:21 user nova-compute[75453]:       </nova:flavor>
Nov 28 14:59:21 user nova-compute[75453]:       <nova:owner>
Nov 28 14:59:21 user nova-compute[75453]:         <nova:user uuid="ff4761ea9f664afd889cdcbda34787ad">tempest-TestVolumeBootPattern-930393037-project-member</nova:user>
Nov 28 14:59:21 user nova-compute[75453]:         <nova:project uuid="193290c25f24467eac18c8a58e647834">tempest-TestVolumeBootPattern-930393037</nova:project>
Nov 28 14:59:21 user nova-compute[75453]:       </nova:owner>
Nov 28 14:59:21 user nova-compute[75453]:       <nova:ports>
Nov 28 14:59:21 user nova-compute[75453]:         <nova:port uuid="16083ebd-df26-40bd-a15a-a3ae1f2e6224">
Nov 28 14:59:21 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 14:59:21 user nova-compute[75453]:         </nova:port>
Nov 28 14:59:21 user nova-compute[75453]:       </nova:ports>
Nov 28 14:59:21 user nova-compute[75453]:     </nova:instance>
Nov 28 14:59:21 user nova-compute[75453]:   </metadata>
Nov 28 14:59:21 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 14:59:21 user nova-compute[75453]:     <system>
Nov 28 14:59:21 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 14:59:21 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 14:59:21 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 14:59:21 user nova-compute[75453]:       <entry name="serial">d78f7954-6146-4786-8d53-348e0489ba14</entry>
Nov 28 14:59:21 user nova-compute[75453]:       <entry name="uuid">d78f7954-6146-4786-8d53-348e0489ba14</entry>
Nov 28 14:59:21 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 14:59:21 user nova-compute[75453]:     </system>
Nov 28 14:59:21 user nova-compute[75453]:   </sysinfo>
Nov 28 14:59:21 user nova-compute[75453]:   <os>
Nov 28 14:59:21 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 14:59:21 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 14:59:21 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 14:59:21 user nova-compute[75453]:   </os>
Nov 28 14:59:21 user nova-compute[75453]:   <features>
Nov 28 14:59:21 user nova-compute[75453]:     <acpi/>
Nov 28 14:59:21 user nova-compute[75453]:     <apic/>
Nov 28 14:59:21 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 14:59:21 user nova-compute[75453]:   </features>
Nov 28 14:59:21 user nova-compute[75453]:   <clock offset="utc">
Nov 28 14:59:21 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 14:59:21 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 14:59:21 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 14:59:21 user nova-compute[75453]:   </clock>
Nov 28 14:59:21 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 14:59:21 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 14:59:21 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 14:59:21 user nova-compute[75453]:   </cpu>
Nov 28 14:59:21 user nova-compute[75453]:   <devices>
Nov 28 14:59:21 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 14:59:21 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 14:59:21 user nova-compute[75453]:       <source dev="/dev/sdb"/>
Nov 28 14:59:21 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 14:59:21 user nova-compute[75453]:       <serial>517a0ea3-4ec6-4a12-b8fb-b2241ad7a574</serial>
Nov 28 14:59:21 user nova-compute[75453]:     </disk>
Nov 28 14:59:21 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 14:59:21 user nova-compute[75453]:       <mac address="fa:16:3e:56:fe:4e"/>
Nov 28 14:59:21 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:59:21 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 14:59:21 user nova-compute[75453]:       <target dev="tap16083ebd-df"/>
Nov 28 14:59:21 user nova-compute[75453]:     </interface>
Nov 28 14:59:21 user nova-compute[75453]:     <serial type="pty">
Nov 28 14:59:21 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/d78f7954-6146-4786-8d53-348e0489ba14/console.log" append="off"/>
Nov 28 14:59:21 user nova-compute[75453]:     </serial>
Nov 28 14:59:21 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 14:59:21 user nova-compute[75453]:     <video>
Nov 28 14:59:21 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 14:59:21 user nova-compute[75453]:     </video>
Nov 28 14:59:21 user nova-compute[75453]:     <rng model="virtio">
Nov 28 14:59:21 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 14:59:21 user nova-compute[75453]:     </rng>
Nov 28 14:59:21 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 14:59:21 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 14:59:21 user nova-compute[75453]:       <stats period="10"/>
Nov 28 14:59:21 user nova-compute[75453]:     </memballoon>
Nov 28 14:59:21 user nova-compute[75453]:   </devices>
Nov 28 14:59:21 user nova-compute[75453]: </domain>
Nov 28 14:59:21 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-352957172',display_name='tempest-TestVolumeBootPattern-server-352957172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-352957172',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ==',key_name='tempest-TestVolumeBootPattern-498211364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-v7aj8yhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T14:59:11Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=d78f7954-6146-4786-8d53-348e0489ba14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:4e,bridge_name='br-int',has_traffic_filtering=True,id=16083ebd-df26-40bd-a15a-a3ae1f2e6224,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16083ebd-df') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG os_vif [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:4e,bridge_name='br-int',has_traffic_filtering=True,id=16083ebd-df26-40bd-a15a-a3ae1f2e6224,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16083ebd-df') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '418b5b2a-2715-5580-8acc-97a4ae15a82e', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16083ebd-df, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16083ebd-df, col_values=(('qos', UUID('caed6db0-8ef4-4c32-af8e-f3ea6bd0c0b5')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16083ebd-df, col_values=(('external_ids', {'iface-id': '16083ebd-df26-40bd-a15a-a3ae1f2e6224', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:fe:4e', 'vm-uuid': 'd78f7954-6146-4786-8d53-348e0489ba14'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:21 user nova-compute[75453]: INFO os_vif [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fe:4e,bridge_name='br-int',has_traffic_filtering=True,id=16083ebd-df26-40bd-a15a-a3ae1f2e6224,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16083ebd-df')
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 14:59:21 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No VIF found with MAC fa:16:3e:56:fe:4e, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 14:59:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:22 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:22 user nova-compute[75453]: DEBUG nova.compute.manager [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received event network-vif-plugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:59:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] Acquiring lock "d78f7954-6146-4786-8d53-348e0489ba14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:59:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:59:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:59:22 user nova-compute[75453]: DEBUG nova.compute.manager [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] No waiting events found dispatching network-vif-plugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:59:22 user nova-compute[75453]: WARNING nova.compute.manager [req-cd1f7ea9-c506-4c40-9163-76b1d6ff246d req-66a81b04-5b51-490b-bb59-b24fe2c964bd service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received unexpected event network-vif-plugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance with vm_state building and task_state spawning.
Nov 28 14:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:24 user nova-compute[75453]: DEBUG nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 14:59:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 14:59:24 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Instance spawned successfully.
Nov 28 14:59:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 14:59:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:59:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:59:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:59:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:59:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:59:24 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 14:59:25 user nova-compute[75453]: INFO nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 28 14:59:25 user nova-compute[75453]: DEBUG nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 14:59:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received event network-vif-plugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 14:59:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] Acquiring lock "d78f7954-6146-4786-8d53-348e0489ba14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:59:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:59:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:59:25 user nova-compute[75453]: DEBUG nova.compute.manager [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] No waiting events found dispatching network-vif-plugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 14:59:25 user nova-compute[75453]: WARNING nova.compute.manager [req-f247dcab-21bb-4f1e-9eee-742b5e8bf567 req-663afa7d-fbbd-4ddd-bdf7-132bbf53ecf1 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received unexpected event network-vif-plugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance with vm_state building and task_state spawning.
Nov 28 14:59:25 user nova-compute[75453]: INFO nova.compute.manager [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Took 14.58 seconds to build instance.
Nov 28 14:59:25 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-727aefb8-3228-43fa-a464-b4d4d5b15f9e tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d78f7954-6146-4786-8d53-348e0489ba14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.666s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:59:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 14:59:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 14:59:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:59:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 14:59:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:54 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:59:55 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:59:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 14:59:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:59:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:59:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 14:59:56 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 14:59:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 14:59:56 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 14:59:56 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:59:56 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 14:59:56 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.008159637451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 14:59:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 14:59:56 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 14:59:57 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance d78f7954-6146-4786-8d53-348e0489ba14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 14:59:57 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 14:59:57 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 14:59:57 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 14:59:57 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 14:59:57 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 14:59:57 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:00:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:00:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:00:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:00:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:00:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:00:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:00:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:00:07 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:08 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid d78f7954-6146-4786-8d53-348e0489ba14 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updating instance_info_cache with network_info: [{"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:00:13 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:00:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:00:21 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:26 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:28 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:31 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:36 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:00:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:00:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:00:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:00:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:00:41 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:00:46 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:00:51 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:56 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:00:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:00:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:00:56 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:00:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:00:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:00:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:00:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:00:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:00:58 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:00:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:00:58 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:00:58 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=25.00753402709961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:00:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:00:58 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:00:59 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance d78f7954-6146-4786-8d53-348e0489ba14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:00:59 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:00:59 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:00:59 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:00:59 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:00:59 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:00:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:01:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:01 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received event network-changed-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Refreshing instance network info cache due to event network-changed-16083ebd-df26-40bd-a15a-a3ae1f2e6224. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] Acquiring lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] Acquired lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Refreshing network info cache for port 16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updated VIF entry in instance network info cache for port 16083ebd-df26-40bd-a15a-a3ae1f2e6224. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updating instance_info_cache with network_info: [{"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:01:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17d99c07-e919-4fb7-a39b-ecbf9d8bf691 req-da222fd9-a87c-4029-8bd3-5537a6ad6946 service nova] Releasing lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:01:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:06 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:08 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:01:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:01:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:01:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Starting instance... {{(pid=75453) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75453) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:01:10 user nova-compute[75453]: INFO nova.compute.claims [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Claim successful on node user
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Start building networks asynchronously for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Allocating IP information in the background. {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.network.neutron [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] allocate_for_instance() {{(pid=75453) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:01:10 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Start building block device mappings for instance. {{(pid=75453) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.policy [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4761ea9f664afd889cdcbda34787ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '193290c25f24467eac18c8a58e647834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75453) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:01:10 user nova-compute[75453]: INFO nova.virt.block_device [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Booting with volume a1e8309f-4559-4e62-870a-16a3b5414df6 at /dev/vda
Nov 28 15:01:10 user nova-compute[75453]: DEBUG os_brick.utils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d090790-74c2-4355-ae9b-3ab570e655e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a6cebdc963c\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[778ad14e-9036-4cec-b2a9-a605f8c6acdc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e5eaf6-d6b9-45df-a97a-acaee90e7637]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bcbfb8-47ea-40d5-bca0-a846e475fc02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Running cmd (subprocess): nvme version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] nvme not present on system {{(pid=75453) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:01:10 user nova-compute[75453]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:01:10 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d68ea0-994f-4169-98b8-23d74aa1fc82]: (4, '') {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75453) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.lightos [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] LIGHTOS: no hostnqn found. {{(pid=75453) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG os_brick.utils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a6cebdc963c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.virt.block_device [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Updating existing volume attachment record: eb79d786-1f82-468f-bf17-e954c0f7cb52 {{(pid=75453) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:01:10 user nova-compute[75453]: DEBUG nova.network.neutron [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Successfully created port: 53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Successfully updated port: 53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquired lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Building network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received event network-changed-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG nova.compute.manager [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Refreshing instance network info cache due to event network-changed-53b94a5a-aa90-4a08-ae72-9a12e49e75f7. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] Acquiring lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Instance cache missing network info. {{(pid=75453) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG nova.network.neutron [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Updating instance_info_cache with network_info: [{"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Releasing lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Instance network_info: |[{"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75453) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] Acquired lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:01:11 user nova-compute[75453]: DEBUG nova.network.neutron [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Refreshing network info cache for port 53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:01:12 user nova-compute[75453]: DEBUG nova.network.neutron [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Updated VIF entry in instance network info cache for port 53b94a5a-aa90-4a08-ae72-9a12e49e75f7. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:01:12 user nova-compute[75453]: DEBUG nova.network.neutron [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Updating instance_info_cache with network_info: [{"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:01:12 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-b19b3a4e-0b54-4f1e-a1a3-770a8219b915 req-ca4b720f-9814-4c8e-a557-10f2617d8b40 service nova] Releasing lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:01:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Skipping network cache update for instance because it is Building. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid d78f7954-6146-4786-8d53-348e0489ba14 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updating instance_info_cache with network_info: [{"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:01:14 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:01:16 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Start spawning the instance on the hypervisor. {{(pid=75453) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Creating instance directory {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:01:17 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Creating image(s)
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Did not create local disks {{(pid=75453) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Ensure instance console log exists: /opt/stack/data/nova/instances/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc/console.log {{(pid=75453) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Start _get_guest_xml network_info=[{"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'eb79d786-1f82-468f-bf17-e954c0f7cb52', 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADCpvlEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1e8309f-4559-4e62-870a-16a3b5414df6', 'serial': 'a1e8309f-4559-4e62-870a-16a3b5414df6'}, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:01:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:01:17 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller missing on host. {{(pid=75453) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.host [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU controller found on host. {{(pid=75453) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75453) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T13:51:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image limits 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flavor pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Image pref 0:0:0 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Got 1 possible topologies {{(pid=75453) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.hardware [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75453) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Calling os-brick to attach iSCSI Volume {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADCpvlEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:01:17 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:01:17 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:01:17 user nova-compute[75453]: INFO os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b71715-dee6-41aa-9364-cd7af332dd63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:01:17 user nova-compute[75453]:  {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b16dec-8c84-462b-af29-6c280faef10b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6] added\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6] added
Nov 28 15:01:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e6843-0c64-482f-a48c-aa4bc22812fd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fce288-b27c-4df5-8cbd-3262a99264e0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADCpvlEm {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADCpvlEm" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6c580e-0e86-4193-9fc3-d963b9bceefd]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ADCpvlEm'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48126eb-b5da-4f4d-b265-0370534bfaa0]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed683ab-7bc9-43d9-ae1c-d6f9fcab9752]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 15:01:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 15:01:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --login {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fe8e14-3434-4c04-a185-b2ee5e2d5a15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6, portal: 172.16.0.220,3260]
Nov 28 15:01:17 user nova-compute[75453]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6, portal: 172.16.0.220,3260] successful.
Nov 28 15:01:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd155944-2366-49dd-a9c5-862d2ec7a23b]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bccb15-0122-46ed-bd7e-ad4e654e34c4]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 15:01:17 user nova-compute[75453]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 (non-flash)
Nov 28 15:01:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 15:01:17 user nova-compute[75453]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 (non-flash)
Nov 28 15:01:17 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to 172.16.0.220:3260 {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75453) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75453) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1373c5-7c2b-4e84-a582-0aaddedbb801]: (4, ('- - 0', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:01:17 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75453) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADCpvlEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75453) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23134316564303631', 'path': '/dev/sdc'} {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134316564303631', 'path': '/dev/sdc'} {{(pid=75453) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-180851206',display_name='tempest-TestVolumeBootPattern-server-180851206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-180851206',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ==',key_name='tempest-TestVolumeBootPattern-498211364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-l4j59bf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:01:10Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75453) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=53b94a5a-aa90-4a08-ae72-9a12e49e75f7,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b94a5a-aa') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG nova.objects.instance [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'pci_devices' on Instance uuid bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:01:18 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:01:18 user nova-compute[75453]:   <uuid>bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc</uuid>
Nov 28 15:01:18 user nova-compute[75453]:   <name>instance-00000034</name>
Nov 28 15:01:18 user nova-compute[75453]:   <memory>524288</memory>
Nov 28 15:01:18 user nova-compute[75453]:   <vcpu>1</vcpu>
Nov 28 15:01:18 user nova-compute[75453]:   <metadata>
Nov 28 15:01:18 user nova-compute[75453]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:01:18 user nova-compute[75453]:       <nova:package version="0.0.0"/>
Nov 28 15:01:18 user nova-compute[75453]:       <nova:name>tempest-TestVolumeBootPattern-server-180851206</nova:name>
Nov 28 15:01:18 user nova-compute[75453]:       <nova:creationTime>2023-11-28 15:01:17</nova:creationTime>
Nov 28 15:01:18 user nova-compute[75453]:       <nova:flavor name="m1.tiny">
Nov 28 15:01:18 user nova-compute[75453]:         <nova:memory>512</nova:memory>
Nov 28 15:01:18 user nova-compute[75453]:         <nova:disk>1</nova:disk>
Nov 28 15:01:18 user nova-compute[75453]:         <nova:swap>0</nova:swap>
Nov 28 15:01:18 user nova-compute[75453]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:01:18 user nova-compute[75453]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:01:18 user nova-compute[75453]:       </nova:flavor>
Nov 28 15:01:18 user nova-compute[75453]:       <nova:owner>
Nov 28 15:01:18 user nova-compute[75453]:         <nova:user uuid="ff4761ea9f664afd889cdcbda34787ad">tempest-TestVolumeBootPattern-930393037-project-member</nova:user>
Nov 28 15:01:18 user nova-compute[75453]:         <nova:project uuid="193290c25f24467eac18c8a58e647834">tempest-TestVolumeBootPattern-930393037</nova:project>
Nov 28 15:01:18 user nova-compute[75453]:       </nova:owner>
Nov 28 15:01:18 user nova-compute[75453]:       <nova:ports>
Nov 28 15:01:18 user nova-compute[75453]:         <nova:port uuid="53b94a5a-aa90-4a08-ae72-9a12e49e75f7">
Nov 28 15:01:18 user nova-compute[75453]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 15:01:18 user nova-compute[75453]:         </nova:port>
Nov 28 15:01:18 user nova-compute[75453]:       </nova:ports>
Nov 28 15:01:18 user nova-compute[75453]:     </nova:instance>
Nov 28 15:01:18 user nova-compute[75453]:   </metadata>
Nov 28 15:01:18 user nova-compute[75453]:   <sysinfo type="smbios">
Nov 28 15:01:18 user nova-compute[75453]:     <system>
Nov 28 15:01:18 user nova-compute[75453]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:01:18 user nova-compute[75453]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:01:18 user nova-compute[75453]:       <entry name="version">0.0.0</entry>
Nov 28 15:01:18 user nova-compute[75453]:       <entry name="serial">bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc</entry>
Nov 28 15:01:18 user nova-compute[75453]:       <entry name="uuid">bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc</entry>
Nov 28 15:01:18 user nova-compute[75453]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:01:18 user nova-compute[75453]:     </system>
Nov 28 15:01:18 user nova-compute[75453]:   </sysinfo>
Nov 28 15:01:18 user nova-compute[75453]:   <os>
Nov 28 15:01:18 user nova-compute[75453]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:01:18 user nova-compute[75453]:     <boot dev="hd"/>
Nov 28 15:01:18 user nova-compute[75453]:     <smbios mode="sysinfo"/>
Nov 28 15:01:18 user nova-compute[75453]:   </os>
Nov 28 15:01:18 user nova-compute[75453]:   <features>
Nov 28 15:01:18 user nova-compute[75453]:     <acpi/>
Nov 28 15:01:18 user nova-compute[75453]:     <apic/>
Nov 28 15:01:18 user nova-compute[75453]:     <vmcoreinfo/>
Nov 28 15:01:18 user nova-compute[75453]:   </features>
Nov 28 15:01:18 user nova-compute[75453]:   <clock offset="utc">
Nov 28 15:01:18 user nova-compute[75453]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:01:18 user nova-compute[75453]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:01:18 user nova-compute[75453]:     <timer name="hpet" present="no"/>
Nov 28 15:01:18 user nova-compute[75453]:   </clock>
Nov 28 15:01:18 user nova-compute[75453]:   <cpu mode="custom" match="exact">
Nov 28 15:01:18 user nova-compute[75453]:     <model>Nehalem</model>
Nov 28 15:01:18 user nova-compute[75453]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:01:18 user nova-compute[75453]:   </cpu>
Nov 28 15:01:18 user nova-compute[75453]:   <devices>
Nov 28 15:01:18 user nova-compute[75453]:     <disk type="block" device="disk">
Nov 28 15:01:18 user nova-compute[75453]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:01:18 user nova-compute[75453]:       <source dev="/dev/sdc"/>
Nov 28 15:01:18 user nova-compute[75453]:       <target dev="vda" bus="virtio"/>
Nov 28 15:01:18 user nova-compute[75453]:       <serial>a1e8309f-4559-4e62-870a-16a3b5414df6</serial>
Nov 28 15:01:18 user nova-compute[75453]:     </disk>
Nov 28 15:01:18 user nova-compute[75453]:     <interface type="ethernet">
Nov 28 15:01:18 user nova-compute[75453]:       <mac address="fa:16:3e:ae:61:c0"/>
Nov 28 15:01:18 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 15:01:18 user nova-compute[75453]:       <mtu size="1442"/>
Nov 28 15:01:18 user nova-compute[75453]:       <target dev="tap53b94a5a-aa"/>
Nov 28 15:01:18 user nova-compute[75453]:     </interface>
Nov 28 15:01:18 user nova-compute[75453]:     <serial type="pty">
Nov 28 15:01:18 user nova-compute[75453]:       <log file="/opt/stack/data/nova/instances/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc/console.log" append="off"/>
Nov 28 15:01:18 user nova-compute[75453]:     </serial>
Nov 28 15:01:18 user nova-compute[75453]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:01:18 user nova-compute[75453]:     <video>
Nov 28 15:01:18 user nova-compute[75453]:       <model type="virtio"/>
Nov 28 15:01:18 user nova-compute[75453]:     </video>
Nov 28 15:01:18 user nova-compute[75453]:     <rng model="virtio">
Nov 28 15:01:18 user nova-compute[75453]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:01:18 user nova-compute[75453]:     </rng>
Nov 28 15:01:18 user nova-compute[75453]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:01:18 user nova-compute[75453]:     <memballoon model="virtio">
Nov 28 15:01:18 user nova-compute[75453]:       <stats period="10"/>
Nov 28 15:01:18 user nova-compute[75453]:     </memballoon>
Nov 28 15:01:18 user nova-compute[75453]:   </devices>
Nov 28 15:01:18 user nova-compute[75453]: </domain>
Nov 28 15:01:18 user nova-compute[75453]:  {{(pid=75453) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-180851206',display_name='tempest-TestVolumeBootPattern-server-180851206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-180851206',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ==',key_name='tempest-TestVolumeBootPattern-498211364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-l4j59bf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:01:10Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=53b94a5a-aa90-4a08-ae72-9a12e49e75f7,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b94a5a-aa') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG os_vif [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=53b94a5a-aa90-4a08-ae72-9a12e49e75f7,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b94a5a-aa') {{(pid=75453) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b20ed04-7142-5ef2-aa98-74b3d1d62334', '_type': 'linux-noop'}}, row=False) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53b94a5a-aa, may_exist=True, interface_attrs={}) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53b94a5a-aa, col_values=(('qos', UUID('8152c762-aa90-4749-ac6a-ff70083aaa22')),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53b94a5a-aa, col_values=(('external_ids', {'iface-id': '53b94a5a-aa90-4a08-ae72-9a12e49e75f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:61:c0', 'vm-uuid': 'bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc'}),), if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:19 user nova-compute[75453]: INFO os_vif [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=53b94a5a-aa90-4a08-ae72-9a12e49e75f7,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b94a5a-aa')
Nov 28 15:01:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75453) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:01:19 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] No VIF found with MAC fa:16:3e:ae:61:c0, not building metadata {{(pid=75453) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received event network-vif-plugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:01:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] Acquiring lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:01:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:01:20 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:01:20 user nova-compute[75453]: DEBUG nova.compute.manager [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] No waiting events found dispatching network-vif-plugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:01:20 user nova-compute[75453]: WARNING nova.compute.manager [req-ea08b886-b0ae-42cf-8d74-824d6b55287c req-015d52d5-1981-4796-8d77-16965ea3b367 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received unexpected event network-vif-plugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance with vm_state building and task_state spawning.
Nov 28 15:01:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Instance event wait completed in 0 seconds for  {{(pid=75453) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Guest created on hypervisor {{(pid=75453) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:01:22 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Instance spawned successfully.
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Found default for hw_cdrom_bus of ide {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Found default for hw_disk_bus of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Found default for hw_input_bus of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Found default for hw_pointer_model of None {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Found default for hw_video_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Found default for hw_vif_model of virtio {{(pid=75453) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.compute.manager [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received event network-vif-plugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] Acquiring lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.compute.manager [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] No waiting events found dispatching network-vif-plugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:01:22 user nova-compute[75453]: WARNING nova.compute.manager [req-a13beff1-4b9b-4336-b35e-5fb227d253e2 req-c56c7c81-78eb-4524-bdb8-ecd070eab816 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received unexpected event network-vif-plugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance with vm_state building and task_state spawning.
Nov 28 15:01:22 user nova-compute[75453]: INFO nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 28 15:01:22 user nova-compute[75453]: DEBUG nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Checking state {{(pid=75453) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:01:22 user nova-compute[75453]: INFO nova.compute.manager [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Took 12.56 seconds to build instance.
Nov 28 15:01:22 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-51617abe-1c2a-40c3-b063-46a75c517b12 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.658s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:01:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:01:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:01:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:01:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:01:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:01:59 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:01:59 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:01:59 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=25.005657196044922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:01:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance d78f7954-6146-4786-8d53-348e0489ba14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing inventories for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating ProviderTree inventory for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Updating inventory in ProviderTree for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing aggregate associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, aggregates: None {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Refreshing trait associations for resource provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75453) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:02:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:02:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:02:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:02:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:04 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:02:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:09 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 15:02:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] There are 0 instances to clean {{(pid=75453) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 15:02:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:14 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:15 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:02:15 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:02:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:02:15 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquired lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:02:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Forcefully refreshing network info cache for instance {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:02:15 user nova-compute[75453]: DEBUG nova.objects.instance [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lazy-loading 'info_cache' on Instance uuid d78f7954-6146-4786-8d53-348e0489ba14 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:02:15 user nova-compute[75453]: DEBUG nova.network.neutron [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updating instance_info_cache with network_info: [{"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:02:16 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Releasing lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:02:16 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updated the network info_cache for instance {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:02:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:02:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:19 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:02:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:24 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:29 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:29 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:31 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:31 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Cleaning up deleted instances with incomplete migration  {{(pid=75453) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 15:02:34 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:39 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:44 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:02:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:49 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:54 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:57 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:02:59 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received event network-changed-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Refreshing instance network info cache due to event network-changed-53b94a5a-aa90-4a08-ae72-9a12e49e75f7. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] Acquiring lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] Acquired lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG nova.network.neutron [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Refreshing network info cache for port 53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75453) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:03:01 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:03:01 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:03:01 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=25.005008697509766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:01 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance d78f7954-6146-4786-8d53-348e0489ba14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75453) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Updated VIF entry in instance network info cache for port 53b94a5a-aa90-4a08-ae72-9a12e49e75f7. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.network.neutron [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Updating instance_info_cache with network_info: [{"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-433d6613-b1fd-4ca6-8fc4-0922ce27af48 req-196c059d-8169-41db-a682-0c028153a4ce service nova] Releasing lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:03:02 user nova-compute[75453]: INFO nova.compute.manager [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Terminating instance
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received event network-vif-unplugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] Acquiring lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] No waiting events found dispatching network-vif-unplugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:03:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-0efc23cd-dac2-4a23-bb97-243859ca91be req-de864f29-cccf-470d-8410-aa7a1ab94fd8 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received event network-vif-unplugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:03:03 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Instance destroyed successfully.
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.objects.instance [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'resources' on Instance uuid bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-180851206',display_name='tempest-TestVolumeBootPattern-server-180851206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-180851206',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ==',key_name='tempest-TestVolumeBootPattern-498211364',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-l4j59bf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:01:23Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=53b94a5a-aa90-4a08-ae72-9a12e49e75f7,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b94a5a-aa') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_vif [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=53b94a5a-aa90-4a08-ae72-9a12e49e75f7,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b94a5a-aa') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53b94a5a-aa, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8152c762-aa90-4749-ac6a-ff70083aaa22) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:03:03 user nova-compute[75453]: INFO os_vif [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=53b94a5a-aa90-4a08-ae72-9a12e49e75f7,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b94a5a-aa')
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADCpvlEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:03:03 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7048b57-a9ad-40a9-8087-676a14d7a07a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:03:03 user nova-compute[75453]: No targets found.
Nov 28 15:03:03 user nova-compute[75453]: iSNS:
Nov 28 15:03:03 user nova-compute[75453]: No targets found.
Nov 28 15:03:03 user nova-compute[75453]: STATIC:
Nov 28 15:03:03 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6
Nov 28 15:03:03 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:03:03 user nova-compute[75453]:                 Iface Name: default
Nov 28 15:03:03 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574
Nov 28 15:03:03 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:03:03 user nova-compute[75453]:                 Iface Name: default
Nov 28 15:03:03 user nova-compute[75453]: FIRMWARE:
Nov 28 15:03:03 user nova-compute[75453]: No targets found.
Nov 28 15:03:03 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:03:03 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:03:03 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0dbf4-7152-4f01-bd33-4518b451bcb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a4ce28-e679-40f4-b6f7-e7f39fa59a85]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 15:03:03 user nova-compute[75453]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 (non-flash)
Nov 28 15:03:03 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 15:03:03 user nova-compute[75453]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 (non-flash)
Nov 28 15:03:03 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f023c54f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6'): ({'sdc'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Removing single pathed devices sdc {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb45b12c-205c-4ec4-a0e1-e89612c119fd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[9876cc9a-6101-4552-a75c-6097e9418e17]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flushing IO for device /dev/sdc {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[1339eb49-ffe3-47c5-952c-3f1fa2180eaf]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f49677-262f-488d-baad-8b383a6d41f6]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] SCSI volumes sdc have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f856a10e-acbf-49b1-868c-d5e1c29494ab]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0b53d4-1f59-400b-9bc9-b1ba4c282079]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6, portal: 172.16.0.220,3260]
Nov 28 15:03:03 user nova-compute[75453]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6, portal: 172.16.0.220,3260] successful.
Nov 28 15:03:03 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e8309f-4559-4e62-870a-16a3b5414df6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc109d3a-c80f-4773-9abb-c0d64b4e7123]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== disconnect_volume: return (303ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:03:03 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Deleting instance files /opt/stack/data/nova/instances/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc_del
Nov 28 15:03:03 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Deletion of /opt/stack/data/nova/instances/bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc_del complete
Nov 28 15:03:03 user nova-compute[75453]: INFO nova.compute.manager [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received event network-changed-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.compute.manager [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Refreshing instance network info cache due to event network-changed-53b94a5a-aa90-4a08-ae72-9a12e49e75f7. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] Acquiring lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] Acquired lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.network.neutron [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Refreshing network info cache for port 53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.network.neutron [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Updated VIF entry in instance network info cache for port 53b94a5a-aa90-4a08-ae72-9a12e49e75f7. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:03:03 user nova-compute[75453]: DEBUG nova.network.neutron [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Updating instance_info_cache with network_info: [{"id": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "address": "fa:16:3e:ae:61:c0", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b94a5a-aa", "ovs_interfaceid": "53b94a5a-aa90-4a08-ae72-9a12e49e75f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:03:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-23df21e4-fa35-420e-a0a8-f96c55d422dc req-caba9ac7-5151-47f4-9b5c-7e09376660f1 service nova] Releasing lock "refresh_cache-bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:03:04 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:03:04 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Took 0.58 seconds to deallocate network for instance.
Nov 28 15:03:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-f811bb21-26b3-4498-a9ed-d2da68991e08 req-917a6764-f687-4e89-ad2c-09133342f874 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received event network-vif-deleted-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:03:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received event network-vif-plugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:03:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] Acquiring lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:03:04 user nova-compute[75453]: DEBUG nova.compute.manager [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] No waiting events found dispatching network-vif-plugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:03:04 user nova-compute[75453]: WARNING nova.compute.manager [req-a832877c-b683-4949-87d0-c3919512bb8b req-5f9bcb0f-cdd6-4e18-99ac-ccdd8f1f0db6 service nova] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Received unexpected event network-vif-plugged-53b94a5a-aa90-4a08-ae72-9a12e49e75f7 for instance with vm_state active and task_state deleting.
Nov 28 15:03:04 user nova-compute[75453]: INFO nova.compute.manager [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 15:03:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:05 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:03:05 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:03:05 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Deleted allocations for instance bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc
Nov 28 15:03:05 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-bf89514e-df68-4e13-82c2-8318dca0f78f tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "bf5d0ef8-5d09-45c3-a22f-dbb3e54dd2cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.811s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:03:08 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:09 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_power_states {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:09 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Triggering sync for uuid d78f7954-6146-4786-8d53-348e0489ba14 {{(pid=75453) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:03:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "d78f7954-6146-4786-8d53-348e0489ba14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "d78f7954-6146-4786-8d53-348e0489ba14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:09 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "d78f7954-6146-4786-8d53-348e0489ba14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:03:10 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:13 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:17 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:03:17 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:03:18 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:23 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:03:28 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:03:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:03:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:03:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:03:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:03:33 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:38 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:43 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:48 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:53 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:58 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:03:58 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received event network-changed-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG nova.compute.manager [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Refreshing instance network info cache due to event network-changed-16083ebd-df26-40bd-a15a-a3ae1f2e6224. {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] Acquiring lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] Acquired lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG nova.network.neutron [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Refreshing network info cache for port 16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d78f7954-6146-4786-8d53-348e0489ba14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d78f7954-6146-4786-8d53-348e0489ba14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "d78f7954-6146-4786-8d53-348e0489ba14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:03:59 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:04:00 user nova-compute[75453]: INFO nova.compute.manager [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Terminating instance
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.compute.manager [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Start destroying the instance on the hypervisor. {{(pid=75453) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received event network-vif-unplugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] Acquiring lock "d78f7954-6146-4786-8d53-348e0489ba14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] No waiting events found dispatching network-vif-unplugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.compute.manager [req-45046706-02e7-4c8c-88da-574b7ecc2dee req-16c76f41-b283-4c31-aa6c-54a485435505 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received event network-vif-unplugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance with task_state deleting. {{(pid=75453) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.network.neutron [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updated VIF entry in instance network info cache for port 16083ebd-df26-40bd-a15a-a3ae1f2e6224. {{(pid=75453) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.network.neutron [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updating instance_info_cache with network_info: [{"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-17840f7f-ade9-4381-8f25-631a95557057 req-5c1cfe8f-3cf4-4d6f-8948-540a82247071 service nova] Releasing lock "refresh_cache-d78f7954-6146-4786-8d53-348e0489ba14" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:00 user nova-compute[75453]: INFO nova.virt.libvirt.driver [-] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Instance destroyed successfully.
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.objects.instance [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lazy-loading 'resources' on Instance uuid d78f7954-6146-4786-8d53-348e0489ba14 {{(pid=75453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.vif [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-352957172',display_name='tempest-TestVolumeBootPattern-server-352957172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-352957172',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7bXE9tzXVeWMGkmvvoutE6LByv/SgbgJ+/FJf7IPUYhZBPfqHt2CAsVJM+OeGzOabP0e9l+yaTHGS7IgQF5QF2NQ/tPwVGfZyT3rhTtQDNyt94Kew6qC+RIVaJpwCIkQ==',key_name='tempest-TestVolumeBootPattern-498211364',keypairs=<?>,launch_index=0,launched_at=2023-11-28T14:59:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='193290c25f24467eac18c8a58e647834',ramdisk_id='',reservation_id='r-v7aj8yhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-930393037',owner_user_name='tempest-TestVolumeBootPattern-930393037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T14:59:25Z,user_data=None,user_id='ff4761ea9f664afd889cdcbda34787ad',uuid=d78f7954-6146-4786-8d53-348e0489ba14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converting VIF {"id": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "address": "fa:16:3e:56:fe:4e", "network": {"id": "e134f287-51ba-4042-9230-b9b6754caa53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2003766815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "193290c25f24467eac18c8a58e647834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16083ebd-df", "ovs_interfaceid": "16083ebd-df26-40bd-a15a-a3ae1f2e6224", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.network.os_vif_util [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:fe:4e,bridge_name='br-int',has_traffic_filtering=True,id=16083ebd-df26-40bd-a15a-a3ae1f2e6224,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16083ebd-df') {{(pid=75453) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_vif [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fe:4e,bridge_name='br-int',has_traffic_filtering=True,id=16083ebd-df26-40bd-a15a-a3ae1f2e6224,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16083ebd-df') {{(pid=75453) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16083ebd-df, bridge=br-int, if_exists=True) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=caed6db0-8ef4-4c32-af8e-f3ea6bd0c0b5) {{(pid=75453) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:00 user nova-compute[75453]: INFO os_vif [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fe:4e,bridge_name='br-int',has_traffic_filtering=True,id=16083ebd-df26-40bd-a15a-a3ae1f2e6224,network=Network(e134f287-51ba-4042-9230-b9b6754caa53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16083ebd-df')
Nov 28 15:04:00 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] calling os-brick to detach iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f023c788c40>, {'target_iqn': 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgcZhKtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:04:00 user nova-compute[75453]: WARNING os_brick.initiator.connectors.base [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18140dc-fdf7-4a7c-addf-f9b0523beb1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:04:00 user nova-compute[75453]: No targets found.
Nov 28 15:04:00 user nova-compute[75453]: iSNS:
Nov 28 15:04:00 user nova-compute[75453]: No targets found.
Nov 28 15:04:00 user nova-compute[75453]: STATIC:
Nov 28 15:04:00 user nova-compute[75453]: Target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574
Nov 28 15:04:00 user nova-compute[75453]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:04:00 user nova-compute[75453]:                 Iface Name: default
Nov 28 15:04:00 user nova-compute[75453]: FIRMWARE:
Nov 28 15:04:00 user nova-compute[75453]: No targets found.
Nov 28 15:04:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:04:00 user nova-compute[75453]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:04:00 user nova-compute[75453]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75453) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574', 0)] {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.042s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6e9225-353b-43e0-9990-4fa647b27bed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[68846db6-683b-405e-a052-04100c815cd7]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 15:04:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 (non-flash)
Nov 28 15:04:00 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f02185a1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574'): ({'sdb'}, set())}) {{(pid=75453) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Removing single pathed devices sdb {{(pid=75453) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f981ce-b75b-405d-974f-79ca6dc59248]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a787e5-2dcc-4a61-9988-c4e43318ef04]: (4, ('ok\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Flushing IO for device /dev/sdb {{(pid=75453) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5b2a2-9b78-45b3-a037-78259573046c]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75453) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:04:00 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[184cf48a-7b7a-4818-b483-618f6904c6b6]: (4, ('1', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.linuxscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] SCSI volumes sdb have been removed. {{(pid=75453) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574')] {{(pid=75453) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.075s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a1bca2-40e1-46a1-b953-dce667f44637]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --logout {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20db63-0ec1-4157-b1ae-354471ce2152]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260]
Nov 28 15:04:01 user nova-compute[75453]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574, portal: 172.16.0.220,3260] successful.
Nov 28 15:04:01 user nova-compute[75453]:  stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op delete {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:517a0ea3-4ec6-4a12-b8fb-b2241ad7a574 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo.privsep.daemon [-] privsep: reply[55551012-e2f0-4280-8905-6b4371d472cb]: (4, ('', '')) {{(pid=86546) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75453) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.base [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] <== disconnect_volume: return (420ms) None {{(pid=75453) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Disconnected iSCSI Volume {{(pid=75453) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:04:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Deleting instance files /opt/stack/data/nova/instances/d78f7954-6146-4786-8d53-348e0489ba14_del
Nov 28 15:04:01 user nova-compute[75453]: INFO nova.virt.libvirt.driver [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Deletion of /opt/stack/data/nova/instances/d78f7954-6146-4786-8d53-348e0489ba14_del complete
Nov 28 15:04:01 user nova-compute[75453]: INFO nova.compute.manager [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo.service.loopingcall [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75453) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG nova.compute.manager [-] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Deallocating network for instance {{(pid=75453) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: d78f7954-6146-4786-8d53-348e0489ba14] deallocate_for_instance() {{(pid=75453) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:04:01 user nova-compute[75453]: DEBUG nova.network.neutron [-] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Updating instance_info_cache with network_info: [] {{(pid=75453) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:04:01 user nova-compute[75453]: INFO nova.compute.manager [-] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Took 0.39 seconds to deallocate network for instance.
Nov 28 15:04:01 user nova-compute[75453]: DEBUG nova.compute.manager [req-02838dfa-cb2a-43a1-89f3-d657e7dc1653 req-9f13f72e-febd-4c7d-95ec-6b5a930453e4 service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received event network-vif-deleted-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received event network-vif-plugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] Acquiring lock "d78f7954-6146-4786-8d53-348e0489ba14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] Lock "d78f7954-6146-4786-8d53-348e0489ba14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG nova.compute.manager [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] No waiting events found dispatching network-vif-plugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 {{(pid=75453) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:04:02 user nova-compute[75453]: WARNING nova.compute.manager [req-0b002c55-9ead-45ce-9da7-a6ff6da0447b req-0478bb16-bb38-43dc-8afc-b5ea1289e06b service nova] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Received unexpected event network-vif-plugged-16083ebd-df26-40bd-a15a-a3ae1f2e6224 for instance with vm_state active and task_state deleting.
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:04:02 user nova-compute[75453]: INFO nova.compute.manager [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] [instance: d78f7954-6146-4786-8d53-348e0489ba14] Took 0.86 seconds to detach 1 volumes for instance.
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:04:02 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:04:02 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:04:02 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9127MB free_disk=25.00394058227539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:04:02 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:04:03 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:04:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:04:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.107s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:04:03 user nova-compute[75453]: INFO nova.scheduler.client.report [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Deleted allocations for instance d78f7954-6146-4786-8d53-348e0489ba14
Nov 28 15:04:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:04:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:04:03 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:04:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-31cf8f58-82ca-48bd-8fd9-5b7b7674d1d3 tempest-TestVolumeBootPattern-930393037 tempest-TestVolumeBootPattern-930393037-project-member] Lock "d78f7954-6146-4786-8d53-348e0489ba14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.163s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:04:03 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:04:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:04:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:04:04 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:04:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:11 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:04:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:04:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:04:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:04:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:04:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:04:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:04:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:04:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:04:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:04:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:34 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:04:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:04:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:04:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:04:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:04:57 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:00 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:05:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:05:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:05:02 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:05:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:05:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:05:03 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:05:03 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:05:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9176MB free_disk=25.002525329589844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:05:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:05:04 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:05:04 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:05:04 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:05:04 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:05:04 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:05:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:05:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:05:06 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:05:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:05:13 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:05:14 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:05:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:05:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:05:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:05:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:05:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:05:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:45 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:05:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75453) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:05:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:05:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75453) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:05:50 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:05:55 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:06:00 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:06:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:02 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75453) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager.update_available_resource {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Auditing locally available compute resources for user (node: user) {{(pid=75453) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:06:03 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:06:03 user nova-compute[75453]: WARNING nova.virt.libvirt.driver [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:06:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Hypervisor/Node resource view: name=user free_ram=9297MB free_disk=24.994503021240234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75453) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:06:03 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75453) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:06:04 user nova-compute[75453]: DEBUG nova.compute.provider_tree [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed in ProviderTree for provider: 4cacb5b9-170e-4610-a8bb-0f50950f49d5 {{(pid=75453) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:06:04 user nova-compute[75453]: DEBUG nova.scheduler.client.report [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Inventory has not changed for provider 4cacb5b9-170e-4610-a8bb-0f50950f49d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75453) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:06:04 user nova-compute[75453]: DEBUG nova.compute.resource_tracker [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Compute_service record updated for user:user {{(pid=75453) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:06:04 user nova-compute[75453]: DEBUG oslo_concurrency.lockutils [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=75453) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:06:05 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:06:07 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:10 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:06:12 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:14 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:15 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:06:16 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:18 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Starting heal instance info cache {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:06:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Rebuilding the list of instances to heal {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:06:18 user nova-compute[75453]: DEBUG nova.compute.manager [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Didn't find any instances for network info cache update. {{(pid=75453) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:06:20 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:06:25 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:06:30 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:06:35 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:06:37 user nova-compute[75453]: DEBUG oslo_service.periodic_task [None req-85f96726-78f8-4dfd-8eff-bfaceb0760ed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:06:40 user nova-compute[75453]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75453) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}